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Abstract 

An  Inertial  Navigation  System(INS),  the  Global  Positioning  System,  and  a  ground 
based  transponder  system(RRS)  can  all  be  used  to  provide  the  user  with  a  navigation 
solution.  Yet  by  integrating  these  three  navigation  systems  with  an  extended  Kalman 
filter(EKF),  a  navigation  solution  is  attained  that  benefits  from  the  information  of  all  three 
subsystems.  This  research  develops  a  multiple  model  EKF  failure  detection,  isolation,  and 
recovery(FDIR)  algorithm  using  a  Chi-Square  failure  test  to  provide  robust  navigation 
solution  to  measurement  failures.  The  algorithm  specifically  counters  failures  in  the  GPS 
and  RRS  range  measurements.  Analysis  is  conducted  using  a  Kalman  filter  development 
package  known  as  the  Multimode  Simulation  for  Optimal  Filter  Evaluation  (MSOFE).  Both 
a  large  order  truth  model  for  the  navigation  system  (in  which  a  full  24  satellite  constellations 
is  modeled)  and  a  reduced-order  Kalman  filter  are  developed.  Results  suggest  that  the 
multiple  model  algorithm  can  correct  for  all  single  measurement  failures. 
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FAILURE  DETECTION,  ISOLATION,  AND  RECOVERY  IN  AN 
INTEGRATED  NAVIGATION  SYSTEM 


/.  Introduction 

Currently  within  the  Air  Force  arsenal,  multiple  navigational  tools  exist  to  help  the 
pilot  navigate  his  plane.  The  three  navigation  tools  that  will  be  the  focus  of  this  research 
are  the  Inertial  Navigation  System(INS),  the  Global  Positioning  System(GPS),  and  the 
ground  based  Range/ Range- Rate  System(RRS).  Each  of  these  tools  generates  a  specific 
form  of  information  about  the  position  and  velocity  of  the  aircraft.  The  purpose  of  an 
integrated  navigation  system  is  to  collect  information  from  the  various  navigation  tools, 
and  then  produce  an  accurate  and  robust  navigation  solution.  The  navigation  solution 
should  consist  of  the  most  accurate  position,  velocity,  and  orientation  estimates  for  the 
aircraft.  Yet  it  is  desirable  for  the  system  to  be  both  accurate  and  robust.  To  be  robust, 
the  integrated  navigation  solution  must  continue  to  operate  as  accurately  as  possible  when 
failures  in  the  system  occur.  This  thesis  will  focus  on  a  failure  detection,  isolation,  and 
recovery  technique  that  will  make  an  integrated  navigation  system  robust  to  GPS  and  RRS 
measurement  failures. 

1.1  Background 

The  topic  pursued  in  this  thesis  emanates  from  ongoing  AFIT  research.  The  over¬ 
all  goal  of  this  research  initiative  is  to  develop  next  generation  navigation  systems  for 
modern  aircraft  and  missile  systems,  This  research  has  been  sponsored  by  the  Central  In¬ 
ertial  Guidance  Test  Facility  (CIGTF),  6585th  Test  Group,  Air  Force  Materiel  Command 
(AFMC),  Holloman  AFB,  NM.  CIGTF  has  sponsored  this  research  in  support  of  their 
navigation  test  range. 

The  past  research  at  AFIT  began  with  the  generation  of  computer  models  for  the 
INS,  GPS,  and  RRS  navigation  systems,  as  well  as  the  development  of  an  integration 
scheme  to  blend  the  information  from  these  three  sources  into  a  single  navigation  solution. 
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AFIT  has  chosen  to  blend  the  information  using  an  extended  Kalman  filler  (EKF).  The 
overall  navigation  system  developed  by  this  early  research  became  know  as  the  Navigation 
Reference  System  (NRS)  [14].  Later  AFIT  research  pursued  failure  detection  algorithms 
to  use  in  conjunction  with  the  NRS,  to  detect  and  isolate  GPS  measurement  signal  failures 
[l9].  The  success  of  this  early  failure  detection  work  ha.s  lead  AFIT  to  pursue  a  failure 
detection,  isolation,  and  recovery  (FDIR)  algorithm  that  will  allow  for  accurate  and  robust 
system  performance. 

1.2  Problem  Definition 

The  research  to  be  conducted  this  year  will  expand  on  past  AFIT  research  to  imple¬ 
ment  a  complete  FDIR  algorithm  for  the  NRS  model.  Starting  with  the  original  NRS,  a 
new  navigation  system  will  be  developed  that  not  can  only  detect  and  isolate  failures,  but 
will  also  reconfigure  to  operate  accurately  during  the  failures.  The  failures  are  errors  in 
the  measurement  signals  received  through  the  GPS  and  RRS  subsystems.  The  new  system 
that  is  developed  in  this  thesis  will  be  referred  to  as  the  Multiple  Navigation  Reference 
System(MNRS). 

This  thesis  will  augment  past  research  in  three  specific  areas.  First  the  research 
will  look  at  failures  in  both  GPS  and  RRS  measurement  signals  as  opposed  to  past  AFIT 
research  which  considered  only  GPS  failures  [19].  The  second  addition  to  this  research 
initiative  is  the  concept  of  robust  navigation.  Pa.st  re.searrh  ha-S  looked  e.xclu.sively  a,t 
failure  detection,  and  isolation(FDI)  techniques.  This  research  is  adding  recoverability, 
to  create  a  complete  FDIR  algorithm.  This  thesis  develops  one  method  of  modifying  the 
NRS  to  make  it  robust  to  failures.  The  development  of  the  MNRS  moves  AFIT  one  step 
closer  to  developing  a  failure  detection,  isolation,  and  reconfiguration  algorithm  for  all 
possible  navigation  failures.  Finally,  this  thesis  explores  various  matching  filter  techniques 
for  identifying  the  exact  type  of  failure  that  is  affecting  the  system.  Two  identification 
techniques  will  be  evaluated  for  future  applicability  to  a  combined  FDIR  algorithm. 
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LS  Scope 

The  scope  of  this  thesis  is  defined  by  the  exact  failures  that  are  to  be  induced  within 
vhe  system.  The  failures  to  be  considered  enter  the  system  through  outside  measurement 
sources.  The  two  prevalent  navigation  measurement  sources  in  the  system  are  the  GPS  and 
the  R.RS  measurement  signals  (see  Figure  1.1).  Errors  in  these  signals  can  be  caused  by 
natural  atmospheric  affects,  failures  in  the  respective  signal  transmitters,  cr  hostile  enemy 
signal  degradation.  Yet  the  actual  source  of  the  failure  is  not  truly  important  to  the  FDIR 
algorithm.  Only  the  effect  of  the  error  source  on  the  measurement  signal  is  important  for 
the  purpose  of  FDIR. 

This  thesis  assumes  that  all  the  failures  in  these  signals  can  be  modelled  as  increased 
noise,  a  step  bias,  or  a  ramp  offset  added  to  the  original  measurement  signal.  Figure  1.2 
shows  how  each  of  these  tailures  would  affect  the  uncorruptea  GPS  or  RRS  measurement 
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TYPES  OF  FAILURES  TO 
BE  DETECTED 


Jammmiiig  of  a  Signal 


Step  Bias  to  a  Signal 


Ramping  Bias  of  a  Signal 


Figure  1.2  Types  of  Failures  Induced  on  Measurement  Signals 


signal.  The  errors  that  affect  the  measurement  signals  are  assumed  to  be  additive  in  nature 
for  this  thesis.  The  use  of  step  and  ramp  additive  failure  offsets  are  standard  methods  to 
simulate  ’’spoofing”  of  a  system. 

The  MNRS  is  limited  to  reconfiguring  itself  for  single  failures.  When  two  failure 
occur,  the  MNRS  can  detect  the  existence  of  the  second  failure,  but  cannot  recover  an 
uiibiS'SSii  solution.  Th.s  slgoritlmi  sJso  no  3,bility  to  isol3,ts  tbo  fsilGcl  ms3.~ 

sureraents  when  more  then  one  failure  occurs.  The  single  failure  limitation  is  mainly  due  to 
limited  computational  modelling  capacity.  To  develop  an  MNRS  system  robust  to  multiple 
failures  would  require  more  parallel  computing  than  is  available  for  this  thesis.  Therefore, 
the  goal  for  development  of  the  MNRS  system  is  robustness  to  single  step,  ramp,  or  noise 
biases  induced  in  either  the  GPS  or  RRS  measurement  signal. 


The  identification  of  failure  type  will  focuses  on  distinguishing  between  step,  ramp, 
and  noise  offset  failures.  Two  different  matching  filter  techniques  are  compared  to  de¬ 
termine  which  more  accurately  identifies  the  type  of  failure  once  it  ha.s  been  detected. 
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Figure  1.3  NR.S  System  Description 


1,4  Brief  System  Description 

The  proposed  MNRS  is  based  on  the  work  accomplished  in  past  AFIT  theses  in 
the  development  of  the  NRS.  The  system  description  will  begin  with  a  description  of  the 
original  NRS,  after  which  the  MNRS  will  be  presented. 

The  original  NRS  consists  of  a  single  EKF  that  gathers  together  information  from  the 
GPS,  RRS,  and  INS  to  produce  a  single  navigation  solution.  The  system  is  modelled  on  a 
Sun  SPARC  workstation  that  simulates  an  aircraft  flying  a  highly  dynamic  flight  profile. 
The  NR.S  navigation  solution  is  the  combination  of  the  continuous  INS  navigation  solution 
and  the  output  from  the  EKF  (see  Figure  1.3).  The  output  of  the  EKF  is  the  estimate 
of  the  errors  in  the  INS  navigation  solution.  Therefore,  the  plane  is  actually  flying  on  the 
INS  output  corrected  by  the  EKF’s  best  estimate  of  the  errors  committed  by  the  INS.  The 
EKF  bases  its  estimate  on  information  it  receives  from  the  INS,  GPS,  and  RR.S.  Therefore, 
the  aircraft  is  navigated  using  the  information  provided  by  all  three  navigation  systems, 
A  more  complete  description  of  the  EKF  and  how  it  is  used  in  t’  e  NRS  is  provided  in 
Chapters  II  and  III. 
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figure  1.4  MNRS  System  Description 


The  MNRS  is  basically  a  multiple  model  implementation  of  the  original  NRS.  The 
MNRS  consists  of  a  bank  of  NRS  navigating  filters  which  run  in  parallel  (see  Figure  1,4). 
Each  NRS  filter  produces  its  own  navigation  solution.  Unlike  traditional  multiple  model 
schemes,  each  NRS  filter  produces  an  accurate  solution  when  no  measurement  failures 
occur.  The  NRS  filters  have  been  designed  in  such  a  way  that  a  failure  in  one  measurement 
signal  (GPS  or  RRS)  will  affect  all  but  one  of  the  NRS  filters.  Whether  a  failure  ha.s 


occurred  or  not  is  decided  in  a  failure  detection  test  conducted  on  each  of  the  NRS  filters 


(see  Figure  1.4).  When  a  failure  occurs,  all  the  NRS  filters  but  one  will  fail  the  detection 
test,  and  navigation  of  the  aircraft  then  continues  on  the  single  filter  that  passes  its  test. 
This  allows  for  robust  navigation  during  the  failure.  A  more  complete  description  of  this 
FDIR  algorithm  is  provided  in  the  literature  review,  Section  1.6.  The  real  benefit  of  using 
the  MNRS  is  that  during  single  failures,  one  and  only  one  of  the  NRS  filters  will  remain 
un:iffected,  which  allows  for  highly  accurate  navigation  during  measurement  signal  failures. 


V  1 
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1.-5  Assunipiion.'i 

All  theses  are  limited  by  the  assumptions  made,  and  no  research  can  be  adequately 
evaluated  unless  these  assumptions  are  clearly  defined.  This  section  outlines  the  assump' 
tions  that  have  been  made  in  this  thesis. 

1.  .\11  work  has  been  conducted  through  computer  simulation.  The  "real"  world  in 
the  simulation  is  modelled  as  a  full-order-state  truth  model.  The  MXRS  filter  is 
represented  by  a  bank  of  reduced-order  filter  models.  This  modelling  struct u.re  has 
been  chosen  to  validate  the  function  of  the  EKFs  in  the  MXRS  [9],  Once  this 
computer  simulation  work  has  been  completed  and  verified,  a  decision  can  be  made 
as  to  whether  it  is  beneficial  to  put  this  theory  into  application.  Vet  this  decision 
cannot  be  made  until  complete  and  thorough  simulation  work  has  been  completed. 
The  full-order  truth  and  filter  models  are  presented  in  Chapter  III. 

2.  The  INS  platform  is  assumed  to  be  stabilized  with  a  barometric  altimeter.  An  INS 
platform  is  unstable  without  an  outside  measurement  source  in  the  vertical  channel 
[l].  While  a  barometric  altimeter  is  not  the  only  way  to  stabilize  a  platform,  it  is 
a  commonly  used  method.  The  use  of  the  barometric  altimeter  is  included  in  the 
modelling  of  the  system. 

3.  sample  period  of  two  seconds  has  been  chosen  for  the  EKF.  The  sample  period 
refers  to  hew  often  GPS  and  RRS  error  measurements  will  be  brought  into  the  EKF. 
Pa, St  A  FIT  research  has  used  a  variety  of  sample  periods,  varying  from  two  to  ten 
seconds  for  the  NRS,  The  decision  to  use  the  two  second  sample  period  has  been 
based  primarily  on  the  computer  facilities  available  and  the  accuracy  of  navigation 
solution  produced.  Various  runs  at  different  sample  periods  confirm  that  this  sample 
period  is  valid  for  simulation  purposes  [19]. 

4.  The  MNRS  model  used  consists  of  a  bank  of  NRS  models  in  parallel.  Each  of 
these  models  ha.s  been  developed  using  differential  equations  representing  the  error 
characteristics  of  the  navigational  system  operating  in  the  real  world.  The  models 
are  based  on  the  theoretical  work  conducted  a,t  CIGTE  and  AFIT  in  developing  error 
state  models  for  the  GPS,  RRS,  and  INS  navigational  systems.  The  GPS  and  RRS 
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models  arc  generic  models  [14],  while  the  INS  model  is  based  on  the  Litton  LN-93 
strap-down  inertial  navigation  system  [4].  A  more  complete  description  of  the  system 
models  is  presented  in  Chapter  III. 

5.  Failures  are  assumed  to  be  additive  in  nature  rather  than  multiplicative.  This  as¬ 
sumption  has  been  made  because  it  both  greatly  simplifies  the  math  and  it  describes 
most  sensor  failures  that  occur  in  the  real  world.  The  algorithms  presented  are  valid 
only  for  failures  of  an  additive  nature. 

6.  The  computer  simulations  have  been  developed  using  a  program  called  Multi-mode 
Simulation  for  Optimal  Filter  Evaluation  (MSOFE)  [13],  MSOFE  is  established  Air 
Force  software  to  develop  and  test  Kalman  filter  algorithms.  The  computer-simulated 
flight  profile  has  been  generated  by  the  program  PROFGEN  [12],  PROFGEN  is 
designed  to  work  with  MSOFE  to  provide  the  necessary  data  files  to  simulate  dy.nainic 
flight  profiles.  The  FDIR  algorithms  are  implemented  using  the  commercial  package 
software  MATLAB  [S], 

7.  The  state  dynamics  matrix  F  is  considered  piecewise  constant,  i.e.  constant  between 
sample  times  two  seconds  apart.  This  assumption  is  necessary  to  implement  the 
discrete  time  GLR  matching  filters  algorithm  developed  in  Section  2.3. 2. 2.  The 
validity  of  this  assumption  has  been  documented  in  past  AFIT  research  [19|. 

8.  The  simulation  software,  MSOFE  and  MATLAB,  has  been  coded  to  run  in  double 
precision  to  increase  numerical  stability  of  the  simulation.  This  is  necessary  due  to 
large  disparities  in  filter  variable.s  that  need  to  be  operated  on  during  the  simulation. 
Due  to  the  fact  that  rescaling  of  the  disparate  variables  is  not  considered  an  effective 
solution  for  this  application,  the  MSOFE  software  implements  a  U-D  factorization 
algorithm  to  increase  the  numerical  stability  in  the  EKF  equations  [13,  9]. 

9.  The  MSOFE  runs  are  conducted  using  15-run  Monte  Carlo  analyses.  While  a  larger 
batch  size  for  the  Monte  Carlo  analysis  would  be  preferable,  this  value  has  been 
chosen  to  keep  the  computational  burden  of  the  thesis  within  reasonable  bounds, 
Single-run  Monte  Carlo  analysis  is  used  for  the  FDIR  runs,  to  reveal  what  ou-liue 
operational  filters  would  see  and  do.  The  single  runs  are  compared  to  the  15-run 
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Monte  Carlo  results  to  ensure  that  the  single  runs  are  reasonable  examples  of  system 
operation. 

10.  The  failure  thresholds  established  for  the  FDIR  algorithm  have  been  established 
empirically,  using  good  engineering  insight  and  verified  through  exhaustive  testing. 

1 1 .  Taylor  series  approximations  truncated  at  first  order  are  used  for  linearizing  nonlinear 
equations  in  the  MNRS  filter.  Perturbations  about  a  nominal  trajectory  will  be 
established  in  each  case. 

12.  A  Doppler  system  is  used  to  provide  velocity  aiding  to  the  INS.  The  measurements 
from  the  Doppler  are  assumed  to  be  ideal  and  tell  the  filler  the  exact  error  between 
the  filter  state  and  the  truth  state.  This  assumption  is  relatively  poor,  yet  the 
development  of  a  complete  Doppler  error  model  is  beyond  the  scope  of  this  thesis. 
Also  the  use  of  the  ideal  Doppler  measurement  allows  for  direct  comparison  to  past 
AFIT  research,  [14,  19]. 

1.6  Literature  Review 

The  goal  of  this  literature  review  is  to  provide  background  information  leading  up 
to  the  choice  of  F'DIR  algorithm  implemented  in  the  integrated  MNRS.  The  review  begins 
with  an  introduction  to  the  basic  coiicepts  of  failure  detection,  isolation,  and  recovery 
(FDIR).  Next,  various  techniques  will  be  analyzed  with  the  criterion  of  applicability  to  the 
navigation  model.  Once  a  background  in  failure  analysis  techniques  has  been  established, 
a  combination  of  techniques  will  be  presented  in  the  form  of  the  MNRS  algorithm.  The 
literature  review  will  conclude  with  an  argument  for  the  use  of  the  MNRS  FDIR.  technique 
for  accurate  and  robust  navigation. 

1.6,1  The  Concept  of  Failure  Analytiis.  Failure  detection  algorithms  analyze 
multiple  information  sources  to  determine  if  erroneous  information  has  entered  a  system. 
The  erroneous  information  could  be  anything  from  a  bias  on  an  incoming  measurement  to 
a  hard  fa.ilure  of  an  entire  subsystem.  Each  algorithm  differs  in  function  and  complexity. 
Simple  algorithms  simply  detect  the  existence  of  failures  in  the  system.  More  complicated 
algorithms  actually  isolate  and  recover  from  failures.  However,  despite  the  differences  in 


1-9 


various  algorithms,  the  fundamental  objective  of  failure  analysis  is  to  examine  information 
in  such  a  way  that  failures  can  be  seen  as  discrepancies  between  different  information 
sources  [21:pp.  601]. 

Failure  analysis  hinges  on  the  availability  of  multiple  information  sources  providing 
redundant  information.  With  only  one  source  of  information,  failed  operation  cannot  be 
distinguished  from  normal  operation  of  a  system.  For  example,  imagine  you  are  driving  a 
car  in  which  the  only  source  of  information  about  your  speed  is  the  speedometer.  In  this 
car,  the  driver  has  no  choice  but  to  rely  on  the  speedometer  for  his  speed  information.  This 
imaginary  car  cannot  employ  failure  analysis,  because  it  contains  no  redundant  information 
sources.  Yet  in  a  real  car,  failure  analysis  algorithms  are  constantly  employed.  In  a  real  car, 
the  driver  has  access  to  multiple  sources  of  information  about  his  speed;  the  speedometer, 
the  sound  of  the  engine,  visual  cues  such  as  the  blurring  of  the  scenery,  and  the  tone  of 
his  passenger’s  voice.  If  the  information  from  the  speedometer  is  contrary  to  ail  his  other 
information  sources,  the  wise  driver  notes  the  inconsistency,  slows  the  vehicle,  and  declares 
a  failure  in  his  speedometer.  The  driver  has  just  performed  the  function  of  FDIR.  While 
the  above  example  may  seem  trivial,  all  FDIR  algorithms  perform  the  same  function  as 
the  driver  did  analyzing  his  multiple  information  sources. 

It  is  important  to  note  in  the  example  that,  while  all  the  sources  of  information  are 
providing  data  about  the  speed  of  the  car,  all  the  information  is  formatted  in  different 
reference  frames  (speedometer  in  miles/hr,  the  passenger  in  decibels).  An  FDIR  algorithm 
needs  to  transform  all  the  information  into  one  frame,  so  that  they  can  be  compared 
equitably.  If  the  information  is  not  transformed  to  a  common  frame,  there  is  no  basis 
for  comparison  [6:pp.  400].  This  concept  will  reappear  in  the  development  of  the  FDI 
algorithm  for  the  integrated  NRS  in  Chapter  III, 

Another  important  concept  in  failure  analysis  is  the  identification  of  failure  types. 
When  a  measurement  or  component  of  a  system  fails,  knowledge  of  the  type  of  failure  that 
has  occurred  can  be  crucial  to  correcting  the  problem.  For  instance,  when  a  speedometer 
goes  bad,  the  driver  can  compensate  for  this  if  he  knows  the  type  of  failure  that  has 
happened  (i.e.,  is  the  speedometer  too  slow  or  too  fast?).  If  the  driver  knows  the  type 
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of  failure,  he  can  adjust  the  value  of  the  measurement  he  reads  from  the  speedometer 
accordingly.  This  process  is  called  corrective  feedback  through  failure  mode  analysis. 

Now  that  a  basic  understanding  of  failure  analysis  has  been  established,  a  review  of 
various  failure  analysis  techniques  is  presented.  Each  technique  will  be  evaluated  on  its 
ability  to  conduct  effective  FDIR. 

1.6.2  The  Voting  Method.  The  simplest  form  of  failure  analysis  is  voting.  To 
implement  simple  voting,  one  needs  at  least  three  redundant  information  sources.  Failure 
detection  and  isolation  is  conducted  by  looking  at  the  three  sources  and  seeing  if  one  is  not 
in  agreement  with  the  other  two.  If  one  source  of  information  disagrees  with  the  other  two, 
then  the  inconsistent  source  is  declared  a  failed  source  [21:pp.  604-605],  If  it  is  possible 
to  continue  operation  with  only  two  information  sources,  the  voting  algorithm  is  able  to 
recover  from  the  failure  and  continue  operation. 

The  benefit  of  this  method  is  its  utter  sim.plicity.  Unfortunately,  simplicity  is  also 
its  major  drawback.  This  FDIR  algorithm  <issumes  majority  rule.  While  this  is  very 
democratic,  it  does  nothing  for  the  user  if  the  one  source  happens  to  be  right  while  the 
other  two  are  wrong.  This  dilemma  can  be  cured  by  increasing  the  number  of  voters.  Yet 
massive  sensor  redundancy  is  impractical  in  the  limited  space  and  computational  domain 
of  avionics  [21:pp.  604-605].  Therefore,  the  voting  algorithm  was  not  seriously  considered 
for  the  integrated  navigation  system. 

1.6.3  The  Chi-Square  Test  (x(}i))-  The  Chi-Square  testing  algorithm[2l]  assumes 
that  a  Kalman  filter  is  being  used  to  blend  the  multiple  information  sources.  A  complete 
presentation  of  Kalman  filter  theory  is  presented  by  Maybeck  [9].  The  Chi-Square  test 
operates  on  the  measurement  residuals  of  the  Kalman  filter  and  decides  whether  a  failure 
has  occurred.  The  Chi-square  test  is  a  function  of  both  the  measurement  residual  vector 
and  the  filter-computed  covariance  of  the  residual  vector.  The  Chi-Square  test  therefore 
is  a  function  of  both  the  size  of  the  residuals  and  the  Kalman  filter’s  confidence  in  the  size 
of  the  residuals.  The  Chi-Square  test  declares  a  failure  when  the  x{h)  function  is  greater 
than  a  pre-determined  threshold.  The  threshold  is  violated  when  the  difference  between  the 
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Kalrnaa  filter  estimate  of  the  incoming  measurement  and  the  actual  measurement  grows 
large  with  regard  to  the  filter-predicted  covariance  of  the  residual.  Past  work  at  AFIT 
has  shown  the  Chi-Square  test  to  be  a  highly  effective  and  consistent  failure  detection 
technique  [2,  5], 

While  the  Chi-Square  test  provides  excellent  failure  detection,  the  algorithm  is  inca¬ 
pable  of  performing  failure  isolation  or  recovery.  As  a  result,  the  Chi-Square  test  cannot 
be  classified  as  a  stand-alone  FDIR  algorithm  [21:pp.  60C-607]. 

1.6.4  Generalized  Likelihood  Ratio  Testing  (GLR).  The  GLR  test[20],  altliough 
similar  to  the  Chi-Square  test,  provides  for  both  detection  and  isolation  of  failures.  Like 
the  Chi-Square  test,  the  GLR  test  uses  the  residuals  of  a  Kalman  filter  as  its  basis  for 
failure  analysis.  Yet  the  GLB.  test  uses  the  residuals  in  such  a  way  that  it  is  able  both  to 
detect  and  to  isolate  failures  [20]. 

The  GLR  test  feeds  the  residuals  of  the  Kalman  filter  into  a  bank  of  estimators, 
each  designed  to  look  for  a  certain,  type  of  failure  mode  (see  Figure  1.5  ).  Examples  of 
failure  modes  are  no  failure,  a  step  failure,  and  a  ramp  failure.  Each  estimator  tests  a 
hypothesis,  fif*,  corresponding  to  a  possible  failure  affecting  the  system.  Hq  corresponds 
to  the  no-failure  hypothesis,  while  Hy  and  H-,  are  the  bias  and  the  ramp  failure  hypotheses 
respectively.  Each  estimator  conducts  its  own  maximum  likelihood  estimate  (MLE)  for  its 
specific  hypothesis.  The  results  of  each  MLE  are  fed  into  a  common  test  logic  algorithm 
(see  Figure  1.5).  This  algorithm  decides  which  hypothesis  is  true,  thereby  determining 
which,  if  any,  failure  has  occurred. 

One  of  the  key  benefits  of  the  GLR  test  is  that  it  needs  only  one  estimator  for  each 
type  of  failure.  The  GLR  algorithm  actually  estimates  unknown  variables  such  as  the 
magnitude  of  the  failure  type  in  its  FDl  process;  therefore  only  one  estimator  is  needed 
for  each  type  of  failure.  This  aspect  greatly  reduces  the  computational  load  of  the  GLR  in 
comparison  to  other  multiple  model  techniques.  Also,  the  estimate  of  the  failure  magnitude 
can  be  used  to  help  develop  a  feedback  loop  to  allow  for  reconfigurability  of  the  system. 
While  it  is  possible  to  use  the  GLR  as  a  complete  FDIR  technique,  past  AFIT  research  has 
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Figure  1.5  Multiple  GLR  Testing 


been  unable  to  produce  accurate  enough  failure  estimates  to  implement  effective  system 
recovery  [19], 

1.6.5  Multiple  Model  Adaptive  Estimation  (MMAE).  MMAE,  like  the  GLR  and 
the  Chi-Square  tests,  exploits  the  information  provided  by  the  residuals  of  Kalman  filters. 
The  strength  of  MMAE  lies  in  its  rapid  reconfigurability.  By  running  multiple  filters  in 
parallel,  residual  information  at  each  update  is  used  to  instantly  reconfigure  the  system 
to  failures.  Unlike  the  previous  algorithms  which  implement  only  a  single  Kalman  filter 
(see  Figure  1.5),  the  multiple  model  structure  of  MMAE  is  fundamentally  designed  for 
robustness  to  known  system  failures. 

To  describe  MMAE,  first  a  failure  space  is  defined  as  all  the  possible  operating  modes 
of  a  system  under  all  possible  failures  that  are  to  be  considered.  The  MMAE  can  be  robust 
to  system  failures  because  it  implements  a  bank  of  Kalman  filters  that  span  the  failure  space 
of  the  system  (see  Figure  1.6).  Each  Kalman  filter  in  the  bank  models  the  operation  of  the 
system  under  a  different  assumed  failure  mode.  To  get  a  single  navigation  solution  out  of 
the  bank  of  filters,  the  outputs  of  all  the  filters  are  blended  together  through  a  probability- 


weighted  average  based  on  the  probability  of  that  filter  modeling  what  is  actually  occurring 
(see  Figure  1.6).  Therefore,  when  no  failure  has  occurred,  the  filter  modelling  no  failure 
gets  a  very  high  weight  (almost  one),  while  all  the  other  models  will  get  very  low  weights 
(almost  zero).  When  a  failure  occurs  those  filters  with  the  best  model  of  the  failure  will  get 
the  highest  weighting  probabilities.  In  Figure  1.6,  one  can  see  that  the  residuals  of  each 
Kalman  filter  are  fed  into  the  algorithm  that  computes  the  relative  weights  placed  on  each 
filter  estimate  [10].  The  real  benefit  of  MMAE  is  that  the  bank  of  Kalman  filters  spans 


Figure  1.6  Multiple  Model  Adaptive  Estimation 


an  entire,  failur?  space.  As  long  as  the  system  being  affected  by  a  failure  remains  within 
the  span  of  this  field,  the  filter  is  robust  to  the  occurrence  of  that  failure  [11].  Therefore 
within  the  scope  of  the  failure  space,  MMAE  is  an  extremely  effective  FDIR  algorithm. 

The  major  drawback  of  MMAE  is  the  high  number  of  Kalman  filters  that  can  be 
necessary  to  span  a  realistic  failure  space.  If  MMAE  is  implemented  with  too  few  filters, 
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none  of  tlia  Kalman  filters  will  have  good  looking  residuals,  thus  limiting  the  accuracy  of 
the  blended  state  estimates.  Yet  the  neces.sary  number  of  models  ca.n  rapidly  grow  into 
the  hundreds,  when  mapping  a  large  failure  space.  For  this  reason,  a  modification  of  the 
MMAE  algorithm  can  often  be  more  effective  than  MMAE  in  its  pure  form  [21]. 

1.6.6  A  Combination  of  2'echniques.  The  three  FDI  algorithms,  MMAE,  GLR 
test,  and  Chi-Square  test,  each  have  their  benefits  and  drawbacks.  For  the  MNRS  the  goal 
is  to  construct  a  single  FDIR  algorithm  that  exploits  the  best  of  all  three  methods. 

The  proposed  MNRS  algorithm  is  fundamentally  a  multiple  model  FDIR  algorithm. 
Multiple  Kalman  filters  run  in  parallel,  each  identical  in  structure,  yet  receiving  different 
sets  of  measurements.  Table  1.1  shows  the  differences  in  the  incoming  measurements 
for  the  ti-ii  filters  used  in  the  parallel  algorithm.  The  first  filter  is  the  one  that  will  be 
used  under  a  no-failure  situation.  It  will  receive  measurements  from  those  satellites  and 
transponders  geometrically  located  to  give  the  best  navigation  information.  While  this 
filter  is  rnr  ning,  nine  other  filters  are  running  in  parallel.  In  each  of  these  nine  filters,  one 
of  the  original  signals  has  been  switched  with  an  alternate  signal  (either  a  new  GPS  signal 
or  transponder  signal).  Therefore,  none  of  the  ten  filters  is  being  updated  with  the  same 
measurement  information.  In  Table  l.l,  satellites  1-4  and  transponders  1-5  combine  for 
the  optimal  navigation  solution  using  the  MNRS.  Satellite  5  and  transponder  6  are  the 
alternate  signals  which  allow  for  the  reconfigurability  under  failure  conditions. 


Table  1.1  MNRS  Filter  Measurement  Structure 


Filter 

Satellites  Used 

Transponders  Used 

1 

1,2, 3 ,4 

1,2,3, 4, 5 

2 

1,2,3,5 

1,2, 3, 4,5 

3 

1,2 ,4 ,5 

1,2, 3,4, 5 

4 

1,3 ,4 ,5 

1,2, 3, 4,5 

5 

2, 3, 4,5 

1,2, 3, 4, 5 

6 

1,2, 3, 4 

1,2,3,4,6 

7 

1,2,3, 4 

1,2,3, 6, 5 

8 

1,2, 3 ,4 

1,2,5,4,5 

9 

1,2,3, 4 

1,6, 3,4, 5 

10 

1, 2,3,4 

6,2, 3,4, 5 
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With  the  above  modelling  structure,  failure  detection  is  conducted  with  the  Chi- 
Square  test.  The  Chi  Square  evaluation  is  run  on  all  ten  filters  (see  Figure  1.7  ).  If  one  of 
satellites  1-4  or  one  of  transponders  1-5  fail,  the  Chi-Square  algorithms  will  signal  a  failure 
in  nine  of  the  ten  filters  (including  Kalman  filter  1,  the  navigating  filter).  At  this  point  the 


navigation  solution  will  be  switched  from  Kalman  filter  1  to  whatever  filter  has  not  failed 
(see  Figure  1.7  ).  In  this  way  the  MNRS  is  robust  in  the  face  of  single  failures  in  satellite 
and  transponder  signals. 
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Httcfs  6>10,  each  usirg  the  four  best 
aateilitea,  and  five  suboptimal  tranpooders 


1 

Kl'  2 
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▼ 

Corrected  Navigation  Solution 
for  all  times 


Figure  1.7  Combined  FDI  Algorithm 


A  major  difference  between  this  algorithm  and  normal  MMAE  lies  in  the  fact  that, 
during  the  no  failure  case,  all  the  separate  filters  are  producing  an  accurate  solution.  In 
a  normal  MMAE,  only  one  accurate  solution  is  ever  produced.  Since  only  one  navigation 
solution  is  needed  in  the  no-failure  case,  the  MNRS  chooses  the  best  filter  output  based  on 
the  location  of  the  RRS  transponder  sites  and  the  GPS  satellites.  Therefore  the  MNRS  is 
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fundamentally  a  combination  of  the  original  MMAE  technique  modified  to  exploit  existence 
of  redundant  sensors  (voting  technique)  and  the  high  quality  of  the  Chi-Square  tests. 

The  MNRS  does  not  use  any  type  of  feedback  to  correct  the  failed  measurement. 
The  failed  measurement  is  abandoned.  While  this  removal  of  the  filled  measurement  from 
the  system  allows  for  highly  accurate  results,  information  is  lost  when  the  measurement  is 
abandoned.  Therefore,  an  effort  is  made  to  examine  matching  filter  teenniques  to  identify 
the  type  of  failure  and  estimate  its  magnitude.  Two  matching  filter  algoTithms  are  consid¬ 
ered.  The  first  matching  filter  algorithm  is  derived  from  the  GLR  test.  This  filter  attempts 
to  distinguish  between  step  and  ramp  failures.  A  failure  magnitude  estiinator  can  also  be 
derived  from  the  GLR  algorithm.  The  second  matching  filter  algorithm  is  an  ad-hoc  de¬ 
sign  based  on  recognizing  failure  types  in  the  output  of  the  Chi-Square  test.  Li  the  MNRS 
diagram,  Figure  1.7,  these  two  different  matching  filter  algorithms  are  represented  by  the 
matching  filter  block.  It  is  hoped  that  this  failure  identification  work  will  allow  recovery 
of  failed  measurements  in  the  future. 

The  structure  for  this  model  has  been  inspired  by  two  separate  sources;  multiple 
model  adaptive  estimation  presented  by  Maybeck  [11]  and  a  robust  navigation  system 
proposed  by  Schwartz  [16].  By  using  different  aspects  of  both  studies,  the  above  algorithm 
has  been  formulated.  It  should  be  noted  that  the  MNRS  algorithm  can  detect  up  to  two 
failures  of  the  system,  yet  it  can  only  isolate  and  reconfigure  for  one  failure  at  a  time. 

L6.7  Literature  Review  Conclusion.  The  Chi-Square  test,  MMAE  algorithms, 
and  matching  filters  are  combined  to  produce  the  MNRS  FDIR  algorithm.  Each  of  the 
individual  failure  analysis  techniques  have  characteristics  that  are  exploited  for  the  benefit 
of  the  overall  navigation  system.  MMAE  provides  the  concepts  of  instant  reconfigurability 
and  multiple  modelling  to  the  combined  FDI  algorithm.  The  Chi-Square  test  is  exploited 
for  its  rapid  failure  detection.  Using  the  Chi-Square  in  each  of  the  distributed  filters  allows 
for  the  validity  of  a  filter  to  be  declared  as  fast  as  possible.  Finally,  the  matching  filters 
are  used  to  identify  the  type  of  failure.  In  this  v/ay,  future  corrective  feedback  can  be  used 
to  bring  the  failed  models  back  on  line  with  the  failure  compensated. 
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1.7  Flan  of  Attack 


The  work  for  this  thesis  divides  itself  into  three  distinct  tasks  to  be  compietcd.  These 
three  steps  in  the  research  are  presented  in  Sections  1.7.1,  1.7.2,  and  1.7.3.  The  first  two 
steps  encompa.ss  the  work  needed  to  get  the  basic  MNRS  operational,  while  the  third  step 
looks  at  ways  of  expanding  the  MNRS  for  future  research. 


1.7.1  Preliminary  Research.  The  introductory  research  began  with  tlie  work 
leading  up  to  the  choice  of  the  MNRS  for  robust  navigation.  The  literature  review,  pre¬ 
sented  in  Section  1.6,  is  the  culmination  of  this  research. 


A  preliminary  study  was  made  to  see  if  a  multiple  model  system  could  adequately 
detect  single  failures.  This  preliminary  test  was  conducted  as  a  class  project  for  the  AFIT 
EE735  class.  The  project  used  a  simplified  INS/GPS  model  and  employed  a  multiple 
model  structure  similar  to  the  MNRS  approach.  The  multiple  filter  system  designed  by 
IxLe  iuuKt::u  iui  lauip,  auu  UXL  lucoxiiiug  xixe 

project  was  cotisidered  only  a  preliminary  study  because  simplified  filter  and  truth  models 
were  used  and  because  transponder  failures  were  not  considered.  The  completed  report 
for  this  project  demonstrated  the  effectiveness  of  the  multiple  model  approach  for  robust 
navigation  [2]. 


The  preliminary  studies  concluded  when  a  choice  was  made  to  go  with  MNRS  system 
using  the  multiple  model  approach  with  the  Chi-square  test  as  the  failure  detection  and 
isolation  algorithm.  Once  the  groundwork  of  the  thesis  had  been  established,  the  actual 
system  development  and  testing  could  begin. 


1.7.2  System  Development  and  Testing.  The  second  phase  of  research  is  pre¬ 
sented  as  a  three-step  process  beginning  with  model  development  and  ending  with  FDIR 
verification. 


1.  Rev/ork  the  original  INS  Litton  LN-93  truth  and  filter  models  based  on  the  most 
recent  research  completed  by  the  Avionics  Directorate,  System  Avionics  Division, 
Wright  Laboratory  (WL/AAAS),  AFMC. 
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2.  Integrate  the  new  INS  model  with  the  original  GPS  and  RRS  models,  and  recode  all 
the  models  on  the  Unix-based  SPARC  computer  system.  Verify  the  operation  of  the 
filter  model  against  the  truth  model. 

3.  Develop  the  computer  code  to  create  the  MNRS  system.  Test  this  multiple  model 
structure  for  correct  operation  in  a  single- failure  environment. 

1.1.3  Advanced  Research  into  Adaptive  Techniques.  The  final  goal  for  this  re¬ 
search  was  to  compare  two  matching  filter  algorithms  to  determine  the  performance  ca¬ 
pabilities  of  each.  While  the  effectiveness  of  the  matching  filters  is  not  crucial  to  the 
operation  of  the  MNRS,  this  work  can  lead  to  future  implementation  of  corrective  feed¬ 
back  algorithms  for  the  MNRS.  The  implementation  of  corrective  feedback  utilizing  the 
matching  filters  is  beyond  the  scope  of  this  thesis. 

1.8  Overview  of  Thesis 

Chapter  II  presents  the  detailed  theory  used  in  the  research.  Kalman  filter  theory  is 
introduced  with  emphasis  on  the  development  of  the  extended  Kalman  filter.  The  theory 
behind  the  various  failure  analysis  algorithms  is  also  explained,  including  the  equations 
implemented  for  the  Chi-square  and  the  matching  filter  algorithms.  Finally,  the  analysis 
used  for  selecting  thresholds  is  discussed. 

Chapter  III  fully  describes  the  navigation  system’s  parameters  and  operational  details 
through  an  overall  system  description.  Models  for  the  INS,  GPS  and  RRS  portions  of  the 
NRS  model  are  defined  in  detail.  A  description  of  how  the  NRS  filters  are  used  in  the 
MNRS  is  also  presented.  This  Chapter  also  presents  various  failure  models  implemented 
in  the  thesis. 

Results  of  the  work  accomplished  are  shown  in  Chapter  IV,  The  reduced  order  ex¬ 
tended  Kalman  filter  used  in  the  MNRS  filters  is  analyzed,  and  a  discussion  of  the  FDIR 
performance  is  presented.  Chapter  V  summarizes  the  research  with  conclusions  and  rec¬ 
ommendations. 
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II,  Kalman  Filtv-nnij  and  Failure  Detection 

2.1  Overview 

Thit>  section  presents  live  fundamental  theory  for  the  application  of  Kalman  filter 
theory  to  the  navigation  probiem,  First,  the  necessary  update  and  propagation  equations 
are  developed  for  a  sampled-data  extended  Kalman  filter  (EKF).  The  EKF  theory  supports 
the  basic  operation  of  the  NRS  model.  Next,  the  failure  detection  and  isolation  theory 
implemented  in  the  MNRS  is  presented.  This  theory  focuses  on  the  development  of  the  Chi- 
Square  test  and  two  matching  filter  algorithms.  The  chapter  concludes  with  a  discussion 
of  the  threshold  selection  criteria  for  failure  declaration  algorithms. 

2.2  The  Extended  Kalman  Filter 

The  MNRS  model  is  generated  using  error  state,  extended  Kalman  filter  (EKF)  equa¬ 
tions.  The  EKF  provides  excellent  state  estimation  of  the  non-linear  time-varying  stochas¬ 
tic  navigation  equations.  These  stochastic  equations  are  linearized  through  approximation 
techniques  about  a  nominal  trajectory  to  form  a  linearized  Kalman  filter  (LKF).  The  LKF 
is  the  basis  for  the  EKF.  The  EKF  expands  upon  the  LKF  by  allowing  the  nominal  tra¬ 
jectory  to  vary  over  time.  The  EKF  relinearizes  its  dynamics  and  measurement  equations 
about  the  best  state  estimate  about  each  update  from  the  GPS  and  the  RRS  measure¬ 
ments,  The  EKF  that  is  implemented  in  this  work  is  considered  a  sampled  data  Kalman 
filter  since  the  measurement  updates  enter  the  system  at  discreie  times. 

2.2.1  The  Sampled  Data  Kalman  Filter.  Let  the  system  model  be  expressed  as 
a  state  equation  of  the  form 


i{t)  =  f[x{t),t]  +  C{t)w{t)  (2.1) 

where  the  state  dynamics  vector  f[x(t),t]  is  a  nonlinear  function  of  the  state  vector  x{t) 
and  time  t.  Let  the  process  noise  input  matrix  G{t)  =  I  and  w{t)  be  a  white  Gaussian 
noise  with  mean: 

=  E  {in(t)}  =  0  (2.2) 
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and  noise  strengtli  Q((;)  defined  by: 


K  {  w[t)uF(t  +  r)}  =  (2.3) 

Incorporate  measurements  ^(t,)  into  the  filter  at  discrete  times  and  define  them  as  a  non¬ 
linear  function  of  the  state  vector  and  time: 


z{ti)  -  h[x{ti),1i]  +  v{U) 


(2.4) 


where  u(<,  )  is  a  zero-mean  white  Gaussian  noise  of  covariance  R{ti)  defined  by: 


R(t,)  for  ti  -  tj 
0  for  ti  ^  tj 


(2.5) 


aiid  i'i[x(<i),  ti]  is  the  nonlinear  observation  vector.  The  LKF  is  based  on  mrturbation  states 
about  a  nominal  state  trajectory  Xr,(t)  satisfying  x„(tn)  =  and 


x„(t)  =  f[x„(f),/]  (2.6) 

where  /[•,  •]  is  shown  in  Equation  (2.1).  The  measurements  are  also  based  on  the  nominal 
states  and  defined  as: 

Zn{ti)  =  h[l^„{ti),U]  {‘2.1) 

The  perturbation  states  are  found  by  subtracting  the  nominal  states  in  Equation  (2.6) 
from  the  original  states  in  Equation  (2.1): 

[x(t)  -  x,.(0]  =  f{x(0,  t]  -  flxn(0'  +  G{t)w{t)  (2.8) 

Equation  (2.8)  is  approximated  to  first  order  through  a  truncated  Taylor  series  expansion: 

6x{t )  =  F  [f;  x„(t)]  6x{t)  +  G{t)yv{t)  (2.9) 
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where  dx{1)  are  the  perturbation  states.  The  dciiiiitions  for  G(i)  and  w(<)  are  unchanged 
and  the  new  linearized  dynaiuic.s  matrix  F[f;x„(t)]  is  found  by  taking  partial  derivatives  of 
lixfi),  i]  with  respect  to  x(J!)  and  evaluated  at  the  nominal  values  for  the  trajectory  x„(/)  : 


F[/;x„(0] 


Ox 


x=x,.o) 


(2.10) 


The  discrete -time  measurements  are  similarly  approxima  ted  to  first  order  and  are  in  the 
perturbed  form; 

<^5(i,)  =  H[ti;x(ti)jSx(i,)  +  v(f,)  (2.11) 


and  the  same  linearization  process  is  used  for  the  measurement  matrix  //[<;:  x„(f,)],  result¬ 
ing  in: 


H[f.;x„(<,)] 


^h[x(f.).b] 

Ox 


X=X„((,) 


(2.12) 


The  LKF  in  this  thesis  generates  error  state  estimates  6x(t),  which  tan  be  added  to  the 
nominal  states  to  provide  whole  states  estimates  x(t)  in  the  form: 


x(f)  -  x„(f.)  +  Sx{t) 


(2.13) 


The  EKP  will  now  be  formed  by  linearizing  about  the  state  estimate  x  rather  than 
the  nominal  trajectory  a:,i.  The  following  equations  use  the  notation  t/t,  to  represent  the 
value  cf  ^  variable  at  time  t,  conditioned  on  the  measuremenis  taken  through  the  time. 
ii,  for  t  benig  any  time  in  the  time  interval  [/,, fi+i).  Also,  t~  represents  the  value  after 
propagation  but  prior  to  the  measurement  update  and  corresponds  to  the  value  after  the 
measurement  update.  The  state  estimates  and  covariance  values  P{t/ti)  are  propagated 
from  ti  to  f.+i  by  solving  the  following  differential  equations: 

kt/t.)  ^  f[x{t/ti}p]  (2.14) 


P(t/t.;)  =  F[<;i(f/f0]F(f/f.)  +  -P(//<i)F^[f;i(t/f.)]  +  C(0Q(0(7"(^) 


(2.15) 


where 


(2.16) 


and  initial  conditions  are  given  by: 


df[x{t),  <] 


dx 


(2.17) 

PiU/U)  -  P{tt)  (2.18) 

The  discrete-time  measurements  are  processed  in  the  EKF  through  update  equations: 

K(U)  =  P(t-)H^[t,;i(t-)]  {77[t,;x(t-)]P(/-)H^[<.;x(<-)]  +  (2.19) 


i(tt)  =  x{tr)  +  K{ti)  {zi  ~  h[xit-).,  (2.20) 

P{it)  =  P{t-)  -  K{U)H[u;x{t-)]P{t7)  (2.21) 


where 


dx 


(2.22) 


and  K(ti)  is  the  discrete-time  Kalman  filter  gain.  Note  that,  I'or  the  EKF,  the  measurement 
and  dynamdcs  matrices  are  relinearized  about  the  last  state  estimate  x{t~ )  rather  than  the 
nominal  trajectory  used  by  a  simple  linearized  Kalman  filter. 


2.3,  S  The  Discrete-Time  Kalman  Fitter.  In  order  to  utilize  the  filter  outputs  in 
the  GLR  matching  filter  algorithm,  it  is  necessary  to  discretize  the  state  dynamics  matrix 
into  a  state  transition  matrix  (STM),  $(ti+i,tj).  All  other  quantities  of  interest  such  as 
K  and  H  are  already  in  discrete  form.  The  STM  must  satisfy  the  following  differential 
equation  and  initial  condition  [;3]: 


d[$(f,f.<)]/dt  =  F{t)^ti,t) 

(2.23) 

(2.24) 
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Defining  At,  =  t,+i  —  U  and  solving  with  F  assumed  constant  over  At  (see  Assumption  7)) 
leads  to: 


e 


f  At 


The  state  equation,  Equation  (2.9)  can  now  be  written  in  the  discrete  form 


(2.25) 


^x(t,+i)  =  +  Grf(t,)Wd(i,) 


(2.26) 


where  Gj  is  assumed  to  be  the  identity  matrix  and  wj  is  defined  as  a  discrete-time  zero- 
mean  white  Gaussian  noise  sequence  with  covariance  kernel: 


E  {wd{ti)w/{tj)} 


Qd(f.)  for  ti  =  tj 
0  for  ii  ^  tj 


(2.27) 


2.3  Failure  Detection  Algorithms 

This  section  presents  the  theory  for  three  failure  analysis  algorithms:  the  Chi-  Square 
test,  the  GLR  matching  filter,  and  the  Chi-Square  residual  matching  filter.  The  Chi- 
Square  test  is  the  failure  detection  algorithm  for  each  NRS  filter  in  the  MNRS  model.  The 
two  matching  filter  algorithms  are  candidates  for  the  failure  type  identification  algorithm 
(identifying  between  failures).  For  an  explanation  as  to  how  these  algorithms  are  combined 
in  the  MNRS  model,  see  Sections  1.6. 

2.3. 1  Chi-Square  Equations.  The  Chi-Square  test  is  designed  to  detect  anomalies 
in  the  residuals  of  a  Kalman  filter.  When  the  magnitude  of  the  residuals  remains  larger 
than  anticipated  through  the  filter-computed  residual  covariance  matrix  over  a  window  of 
time,  the  Chi-Square  test  declares  a  failure.  The  Chi-Square  test  is  a  highly  simplistic  yet 
powerful  tool  that  is  capable  of  detecting  failures  rapidly  and  accurately. 

The  Chi-Square  test  declares  a  failure  based  on  the  size  of  the  the  extended  Kalman 
filter  residuals,  7(ti).  The  EKF  residuals,  first  seen  in  Equation  (2.20),  are  defined  in 
Equation  (2.28).  These  residuals  are  zero  mean  and  appear  white  to  first  order  with 
known  covariance,  A(<j). 


7(t,)  =  )>^.] 


(2.28) 


(2.29) 


The  Chi-Square  test  is  a  function  of  the  Chi-Square  random  variable,  xi^k),  and  is 
given  by 

X{tk)=  7^(ti)A-^(ti)7(ti)  (2.30) 

i  =  k-N+l 


with  N  being  the  size  of  a  sliding  window  in  time.  In  Equation  (2.30),  the  residuals,  7(ti), 
are  squared  to  remove  sign  cancellation  in  the  summation.  The  square  of  the  residuals  is 
scaled  by  the  inverse  residual  covariance,  to  take  into  account  the  confidence  the  filter  has 
in  its  residuals  at  that  moment.  The  use  of  the  sliding  window  in  time,  rather  than  a  full 
history  from  to,  reduces  the  computational  load  and  increases  the  accuracy  of  the  detection 
algorithm.  The  delay  time  from  failure  occurrence  to  failure  detection  is  a  function  of  the 
size  of  the  window,  N.  A  small  window  size  decreases  the  detection  time,  however  the  small 
window  also  increases  the  likelihood  of  false  alarms.  Therefore  the  size  of  the  window,  N, 
is  chosen  to  balance  the  trade-off  between  detection  delay  and  false  alarm  rate.  The  Chi- 
oquare  test  will  declare  a  failure  based  on  a  simple  threshold  test. 


.  \  'w  ,  _t  ri  r  r  rr  n  IT 

W^k)  ^  i:  ijyJ 

X{h)  <  NO  FAILURE  (2.31) 


The  end  of  Chapter  II  will  present  more  detail  on  the  methodology  of  threshold  choos¬ 
ing,  and  Chapter  III  will  go  into  greater  detail  as  to  how  the  Chi-Square  algorithm  is 
implemented  in  the  MNRS  model. 

2.3.2  GLR  Matching  Filter.  The  GLR  matching  filter  algorithm  is  designed  both 
to  distinguish  between  different  types  of  failures  and  to  estimate  the  magnitudes  of  the 
failure  types,  The  GLR  matching  filter  algorithm  pursued  in  this  thesis  is  derived  from  the 
generalized  likelihood  ratio  equations  [20].  Therefore,  before  the  GLR  matching  filters  are 
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presented,  the  generalized  likelihood  ratio  will  be  fully  presented.  Afterwards,  the  GLR 
matching  filters  used  in  the  algorithm  will  be  derived  from  the  fundamental  GLR  theory. 

2.3.2. 1  Derivation  of  the  GLR  Equations.  The  derivation  of  the  GLR 
test  will  be  divided  into  five  steps.  The  derivation  centers  around  the  development  of  a 
likelihood  equation  based  on  tw'o  different  hypotheses.  One  hypothesis,  Hq,  represents 
a  no-failure  system.  The  second  hypothesis,  Hi,  represents  a  specific  failure  type  added 
to  the  system.  As  stated  earlier  in  Section  1.3,  the  failures  induced  for  this  thesis  will 
be  additive  terms  in  the  measurement  updates.  The  ratio  of  the  log-likelihood  of  the 
two  hypotheses  will  be  used  to  generate  a  threshold  function,  which  satisfies  the 

following  criteria. 


>  T=>  FAILURE 

l{ti,d)  <  NO  FAILURE  (2.32) 

If  l{ti,0)  is  less  than  some  threshold,  T,  then  Ho  is  true.  Similarly  Hi  is  true  if  1(1,,$)  is 
greater  then  the  T.  The  following  steps  describe  the  derivation  of  the  GLR  algorithm  for 
a  single  failure  type,  a  step  failure. 

1.  Step  One,  Define  the  Hypotheses  Hq  and  Hi 

The  derivation  of  the  GLR  test  begins  with  the  establishment  of  the  two  hypotheses, 
each  based  on  a  different  set  of  discretized  extended  Kalman  filter  equations.  The  first 
hypothesis,  Hq  (no  failure),  comes  from  discretized  EKF  equations  (Equations  (2.33) 
and  (2.34))  that  assume  that  no  failure  has  occurred. 


6x{ti+i)  =  #(<<+i,(<)5x(ti)  -t-  Gi{ti)wd{ti)  (2.33) 

6z\ti)  =  Il{ti)i)x{ti)  -h  v{ti)  (2.34) 

The  second  hypothesis  assumes  that  an  additive  failure  has  occurred  on  the  mea¬ 
surement  signal.  Throughout  this  section  the  superscript  notation,  0  and  1  refer  to 
variables  associated  with  Hypotheses  Hq  and  Hi  respectively.  These  equations  have 
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an  extra  term  that  reflects  the  nature  of  the  failure  (Equations  (2.35)  and  (2.36)). 


Sx{ti+,)  =  +  Gditi)^4{ti)  (2.35) 


=  H{ti)6x{ti)  +  v{ti)  +  d{ti)n[ti,6)u 

where 


d{ti) 

n{ti,0)  = 

u  = 

e 


failure  vector 
failure  function 
unknown  size  of  the  failure 
unknown  time  of  the  failure 


(2.36) 


Comparison  of  Equations  (2.34)  and  (2.36)  reveals  that  the  Hi  hypothesis  is  char¬ 
acterized  by  the  failure  offset  term,  d{ti)n{ti,d)u.  The  components  of  thi  term  de¬ 
termine  the  type  of  failure  that  the  GLR  algorithm  is  trying  to  detect.  The  n{ti,0) 
dictates  the  time  of  failure  onset,  0,  and  the  type  of  failure  that  has  occurred,  i.e. 
ramp  offset,  step  offset,  etc.  The  u  is  the  magnitude  of  the  failure.  The  column  vec¬ 
tor,  d{ti),  specifies  which  of  the  measurement  signals  has  the  failure.  Chapter  III  will 
fully  describe  the  failure  models  for  both  d{ti)  and  n(<i,0).  One  of  the  real  benefits 
of  the  GLR  algorithm,  as  stated  in  Section  1.6,  is  that  the  unknown  variable,  u,  is 
estimated  in  the  GLR  algorithm.  Therefore  v  does  not  need  to  be  predetermined  for 
the  hypothesis,  Hi. 

2.  Step  Two  Development  of  the  Residual  Equations 

Similar  to  the  Chi-Square  algorithm,  the  GLR  test  focuses  on  the  residuals  for  its  fail¬ 
ure  information.  Therefore  the  GLR  derivation  hinges  on  the  development  of  residual 
equations  for  the  two  different  hypotheses  Ho  and  Hi.  These  residual  equations  are 
derived  from  Kalman  filter  equations  developed  for  each  of  the  two  hypotheses.  Equa¬ 
tions  (2.37)  and  (2.38)  represent  the  residual  equations  for  Ho  and  Hi  respectively: 

=  H{U)6x\ti)  +  v(<i)  -  (2.37) 

7‘(fi)  =  ll{ti)6x^{ti)  +  v(<,)  -  H(f,)6x^~(fi)  -t-  d{ti)n{ti,0)L>  (2.38) 
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Equations  (2.37)  and  (2.38)  are  rewritten  using  the  following  definitions, 


e^{ti)  =  6x\ti)-6x^~{ti) 


to  yield, 


+  v(t.) 


=  H(t.)e*(ti)  +  v(ti)  +  d{t.i)n{ti,e)i/ 


(2.39) 

(2.40) 


(2.41) 

(2.42) 


With  these  definitions  in  hand,  the  ne.xt  step  in  the  derivation  is  to  find  an  expression 
for  e(fj)  in  terms  of  known  model  parameters. 

3.  Stvep  Three,  Define  expressions  for  e“(t<)  and  e^(f,) 

The  method  for  developing  the  expressions  for  either  e(fi)  will  be  demonstrated  by 
developing  e\t;).  Using  the  expression  developed  for  e\ti)  in  Equation  (2.40),  a  new 
expression  can  be  developed  by  using  Equations  (2.35),  (2.28)  and  (2.20).  This  new 
expression.  Equation  (2.43)  puts  e^(t,)  into  a  recursive  form: 


e\ti+i)  =  +  Gi(<.)Wd(fj)  - 


(2.43) 


In  the  above  equation,  A’’(<<)  represents  the  Kalman  filter  gain  at  time  ti  as  de¬ 
fined  in  Equation  (2.19).  Equation  (2.43)  can  be  further  expanded  by  substituting 
Equation  (2.42)  for  After  several  algebraic  simplifications.  Equation  (2.43)  is 

rewritten  as. 


^(^+i,^;)A'(t,)[v(ij)  -I-  d(fi)n(ti,ff)i/]  (2.44) 

This  is  the  desired  form  for  A  similar  derivation  yields  the  following  expression 

for  e°(f,). 


e't^+i)  =  -f.  G,(f.)w,(/.] 
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(2.45) 


The  two  equations  derived  in  Step  3,  Equations  (2.44)  and  (2.45),  will  be  used  later 
in  the  derivation  to  attain  the  hnal  form  of  l{ti,6). 

4.  Step  Four  Derive  a  new  expression  for  7'(ij) 

This  is  the  Ciucial  step  in  the  derivation.  The  goal  is  to  develop  a  new  expression  for 
7^(t,  )  in  terra.i  of  7°(t,)  and  other  terms  that  are  readily  available  from  a  Kalman 
filter.  To  accorr  j.ijish  this  we  start  by  rewriting  Equation  (2.38)  in  the  following  form, 

+  9{U,  Oji'  (2.46) 

where  9)  is  a  function  of  only  parameters  available  from  the  EKF.  Let 
he  of  the  form, 

g{ti,e)  =  K{u)fiu,e)  +  d{ti)n{ti,e)  (2.47) 

It  is  therefore  necessary  to  find  an  expression  for  that  will  satisfy  the  above 

equations.  This  expression  is  found  by  substituting  in  all  the  other  known  quantities 
into  Equation  (2.46).  Expressions  for  7^(fi)  and  7°((j)  are  found  in  Equations  (2.41) 
and  (2.42): 


Jfj.  \-./j  n\..  TT/'j  \  I  -./a  \  I 

vw j  “T  j  + 

[H(t.)^  (t,,0)  +  d{ti)n{ti,e}]u 


(2.48) 


After  cancellation  Equation  (2.48)  can  be  rewritten  in  the  form. 


(2.49) 
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It  is  now  beneficial  to  put  Equation  (2.49)  into  a  recursive  form  for  Restating 

Equation  (2.49)  for  t  =  yields  the  following  expression, 


SiU+iJ)  =  (2.50) 

Now  the  terms  on  the  right  side  of  Equation  (2.50)  are  expanded  so  that  /(ti+i ,  6)  be¬ 
comes  a  function  of  and  other  known  quantities.  Equations  (2.44)  and  (2.45) 

from  Step  Four  provide  expressions  for  e'(t, ^,)  and 

J{U+u9)  =  ^L(^(«i+i,«.)[/  -  Kiti)li{t,)]e\U)  +  Gd(t,)Wi(ti)  - 

+  d{ti)n{ti,e)u])  - 

$(<<+i,<.)A'(t,)v(t.))]  (2.51) 


This  expression  can  be  simplified  to  yield, 

=  i{^(<.,,,f,)[i-A'(t,)H(«,)](e'(<i)-e«(tO)- 

^(«.+i ,  U  )Kiti)diti)n{ii ,  6)1^] }  (2.52) 

Now  Equation  (2.49)  is  used  to  complete  the  recursive  formula  for 

-  K{U)n{ti)]f{tiJ)  -  <>(<i+i,tOA'(t.)d(t,)n(t.,0)  (2.53) 

Therefore  at  this  point,  recursive  equations  have  been  developed  for  residuals  of  the 
two  hypotheses,  no  failure  and  failure: 

Ho  :  'r{ti)  =■■  l\ti)  (2.54) 

Hi  :  7{U)  ^  g[t„9)i^  (2.55) 

The  expressions  for  g{ti,9)  can  be  developed  from  Equations  (2.47)  and  (2.53). 

5.  Step  Five  The  Likelihood  Ratio 
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Now  that  expressions  have  been  developed  for  the  residuals  of  the  two  hypothesis, 
the  likelihood  ratio  needs  to  be  established  to  determine  which  of  the  hypotheses  the 
residuals  actually  match.  We  derive  the  likelihood  ratio  from  the  knowledge  that 
both  hypotheses  residuals  are  Gaussian  random  variables  that  are  independent  in 
time  [15].  We  now  define  the  following  probability  ratio: 


L(ti,e,v)  = 


A7(^o)'7(^q+i),7(<o+2) . 

y{to+i),  7(<o+2), . ,  7(<i  )l^o) 


(2.56) 


n  _ [ 

r  _1 - e-i7('«rA«n)-'7d»)l 

The  product  functions  in  Equation  (2.56)  represent  the  product  of  the  probabilities 
at  each  measurement  update  from  time,  0,  up  to  and  including  the  current  time, 
t;,  To  simplify  Equation  (2.56),  we  use  the  log-likelihood  function  in  place  of  the 
likelihood  function.  This  is  accomplished  by  taking  the  natural  log  of  both  sides  of 
Equation  (2.56).  After  several  algebraic  simphfications,  this  equation  becomes, 


ln{L(ti,6,v))  =  A{tnr^g{tnJ)] 

«n=« 


Similar  to  the  product  notation  of  Equation  (2,56),  the  summation  in  the  equa¬ 
tion  above  represents  the  sum  of  the  terms  at  each  measurement  update  from  time, 
6,  up  to  and  including  the  current  time,  tj.  This  notation  continues  in  Equa¬ 
tions  (2.58),  (!’.59),  and  (2.67)  This  equation  is  rew'ritten  in  the  form, 


where  $(t,-,0)  and  5(1,, 0)  are  defined  below. 

t„=e 


(2.57) 


(2.58) 


(2.59) 
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Now  it  is  iiocessary  to  remove  the  dependence  on  i/  from  Equation  (2.57).  This  is 
done  by  finding  the  Maximum  Likelihood  Estimate(MLE)  of  for  Equation  (2.57). 
This  is  accomplished  by  taking  the  derivative  of  Equation  (2.57)  with  respect  to  the 
variable  u  and  setting  it  equal  zero: 


d[ln{L{ti,e,u))] 

dv 


=  nti,e)-yS{UJ)  =  0 


S{UJ) 


(2.60) 


Now  that  the  MLE  of  u  has  been  found  over  the  interval  substitute  this  value  back 
into  Equation  (2.57).  This  yields  the  following  maximum  likelihood  equation: 


2S{u,e) 


(2.61) 


Now  the  expression  for  l(ti,6)  is  maximized  over  6  to  obtain  the  maximum  likelihood  esti¬ 
mate.  This  is  the  final  form  of  the  Generalized  Likelihood  Ratio  test.  If  exceeds  a 
predetermined  threshold  T  then  a  failure  of  type  n(<i,6i)  will  be  declared  on  the  measure¬ 
ment  specified  in  d{ti).  The  GLR  magnitude  estimate  of  this  failure  will  be  r>  as  defined 
in  Equation  (2.60). 

2. 3. 2. 2  Development  of  the  GLR  Matching  Filter.  While  the  GLR  al¬ 
gorithm  defined  in  the  previous  section  is  designed  to  function  as  a  stand-alone  failure 
detection  and  isolation  algorithm,  the  GLR  matching  filter  algorithm  performs  a  more 
limited  role  within  the  MNRS  model.  The  GLR  matching  niters  will  be  provided  with 
failure  detection  and  isolation  information  from  the  bank  of  Chi-Square  tests  that  are  run 
on  each  NRS  filter.  Given  the  failure  information  from  the  Chi-Square  tests,  the  GLR 
matching  filter  must  then  identify  the  type  of  failure.  Specifically,  the  GLR  matching  filter 
algorithm  will  attempt  to  differentiate  between  step  and  ramp  failure  offsets.  There  is  no 
GLR  failure  model  available  for  the  noise  offset,  therefore  a  Generalized  Likelihood  Ratio 
is  not  developed  for  the  noise  offset.  Fundamentally  this  is  done  by  comparing  the  results 
of  different  GLR  matching  filters,  and  choosing  which  best  fits  the  residuals.  Each  GLR 
matching  filter  can  also  estimate  the  magnitude  of  the  failure.  This  section  derives  the 
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GLR  matching  filters  from  the  previously  defined  GLR  equations,  and  explains  how  the 
matching  filters  accomplish  failure  identification  and  estimation.  Before  this  can  be  done 
however,  the  information  provided  by  the  Chi-Square  test  must  be  defined. 

The  first  piece  of  information  is  the  identity  of  the  failed  measurement  signiil.  The 
knowledge  of  which  measurement  update  is  failed,  allows  the  GLR.  vector  d(t,  )  to  become 
the  fixed  vector  dj^(ti)(subscript  x  signifies  dependence  on  Chi-Square  failure  information). 
The  second  piece  of  information  provided  by  the  Chi-Square  test  is  its  best  estimate  of 
when  the  failure  occurred.  This  estimate  is  based  on  experimental  analysis  of  Chi-Square 
detection  delay.  The  knowledge  of  the  Chi-Square  estimate  allows  the  variable  0  to  become 
the  known  estimate  0^. 

These  two  simplifications  greatly  reduce  the  computational  burden  of  the  GLR  al¬ 
gorithm.  In  fact  the  extra  information  reduces  the  GLR  equations  into  simple  matching 
filter  equations.  Rather  than  having  a  maximum  likelihood  estimate  over  the  variable  0^ 
the  GLR  equation  reduces  to  the  following; 


2S^{ti,0)() 


(2.62) 


with  dy{ti)  and  0^,  predetermined  by  the  MNRS  Chi-Square  tests.  The  GLR  equation  has 
now  been  reduced  to  a  function  of  only  time,  t,-. 


To  implement  the  failure  type  identification,  two  GLR  matching  filters  are  con¬ 
structed,  one  for  a  step  bias  and  one  for  a  ramp  offset.  These  filters  are  unique  because 
they  are  each  driven  by  two  different  failure  models,  ^x)  ^x)-  ^he 

definitions  for  the  different  failure  models  are  provided  in  Section  3.4.3.  It  is  important  to 
note  that  the  Chi-.Square  estimate  of  the  failure  time,  does  not  take  into  account  the 
detection  delay  inherent  in  the  step  and  especially  the  ramp  offsets.  Compensating  for  this 
failure  detection  delay  in  the  failure  models  is  addressed  in  Section  3.4.5.  Continuing  on, 
for  each  of  the  two  failure  models,  n,,cp  and  n-rami,,  a  GLR  matcliing  filter  is  now  defined 
as, 


^j<ep(h’ ) 


2S,up{ti,0^) 


(2.63) 
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(2.64) 


*r(imp  V  *  I )  y  — 


(U,e^) 


^‘^ra/npi^^i^  ^x) 

where  the  fi.rst  equation  is  a  function  of  71,, ep(ti, 0^^,)  and  the  second  eqiuition  is  a  function 
of  nrampiU’^^x)-  A  Tatio  of  these  two  equations  is  defined  as  T(<i), 


y/A  \  _  ^rampi^it 


(2.65) 


This  equation  simplifies  through  cancellation  and  use  of  Equations  (2. 58), (2. 59), and  (2.61) 
to  reach  the  following  result. 


T(<,)  = 


(2.66) 


^  °  (Eil=«-  (g»7ep(in,^Xr^(‘")’'‘7(«»)])^E|U»  [9rampiin,0^V\{t„)'^gram!XtnJx)] 

(2.67) 

where  the  subscripts,  ramp  and  step,  correspond  to  a  function  that  has  the  respective  failure 
model  as  an  input.  Similar  to  the  original  GLR  algorithm,  the  ratio  of  matching  filters, 
T(t,),  will  be  compared  to  thresholds  to  determine  which  type  of  failure  has  occurred.  If 
the  failure  is  a  ramp  bias,  the  ratio  of  matching  filters  shoula  be  much  greater  than  the 
one,  therefore  T(f,)  should  be  much  larger  than  one.  Likewise  T(<i)  should  be  much  less 
than  one  if  a  step  bias  has  occurred.  Yet  if  the  failure  is  additive  random  noise,  neither  of 

j.1.^  r-M _ _ - 4.-1,  x-.:! -  ■v/.*  \  - - _ - 4.-K.  « 

tiL^  iiiuud&  MiOuiu  i<uiuit;,  €tiiu  -l  j  Micaiu  uiit;. 

Therefore  two  failure  type  thresholds  will  be  established  for  T(fi), 


Failure  Type  =  | 


Ramp  Bias 
Step  Bias 
Noise  Bias 


if  T(^)  >  Ti 
if  T(f.)  <  n 
otherwise 


(2.68) 


The  I'l  >>  1,  ramp  bias  ,  and  T2  «  1,  step  bias  thresholds  are  experimentally  established 
thresholds.  With  the  proper  choice  of  thresholds  the  T(fj)  will  accurately  determine  failure 
type. 
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The  inagnitiidc  of  the  failure  type  is  determined  from  Equation  (2.60).  Th;'.;  equation, 
calculated  for  botli  step  and  ramp  failure  models,  will  estimate  the  size  of  the  failure  at 
each  point  in  time,  #,  >  9^.  The  determination  of  which  estimate  is  valid  depends  on  the 
outcome  of  the  ratio  between  matching  filters,  T(<,  ).  13y  using  Equations  (2.60)  and  (2.66), 
a.ccurate  c-stimates  can  be  made  of  both  the  size  of  a  step  bias,  and  the  slope  of  a  ramp 
offset.  Unfortunately,  since  there  is  no  failure  model  for  the  noise  bias,  an  estimate  of  the 
magnitude  of  a  noise  bias  cannot  be  determined. 

This  section  has  defined  the  role  of  the  GLR.  algorithm  for  the  MNRS  FDIR  system. 
The  GLR  has  been  modified  to  use  predetermined  information  from  the  MNRS  Chi-Square 
test  to  ease  computational  burden  and  increase  the  likelihood  of  accurate  estimation.  While 
theoretically  the  GLR  matching  filters  should  effectively  cuccomplish  failure  identification 
and  estimation,  past  AFIT  research  has  only  had  limited  success  with  the  GLR  algorithm. 
Therefore,  a  second  matching  filter  algorithm  is  also  developed  to  compare  with  the  GLR 
matching  filters. 

2.3.S  2'he  Chi-Square  Pattern  Recognition(CSPR)  Matching  Filter.  The  CSPR 
filter  identifies  consistent  trends  in  Chi-Square  magnitude  plots  that  can  distinguish  failure 
type.  The  filter  is  based  on  the  premise  that  step  and  ramp  offsets  affect  the  residuals  in 
distinct  manners  that  are  obvious  in  the  Chi-Square  results.  By  examining  the  Chi-Square 
magnitude  data  over  the  time  of  failure,  the  type  of  failure  is  determined.  Like  the  GLR 
algorithm,  it  is  assumed  that  the  Chi-Square  estimate  of  the  failure  and  the  identity  of  the 
failed  measurement  are  known.  To  understand  the  implementation  of  the  CSPR  matching 
filter  algorithm,  the  scope  of  the  filter’s  theoretical  development  needs  to  be  clarified. 

The  CSPR  algorithm  has  been  developed  through  post-process  examination  of  the 
impact  of  failures  on  the  residual  and  Chi-Square  plots.  These  Chi-Square  results  and  the 
results  of  past  FDIR  EKF  work  imply  that  the  failure  type  can  be  determined  by  the  shape 
of  the  Chi-Square  test  over  the  time  of  failure  [2,  5].  This  thesis  in  no  way  implies  that  the 
CSPR  algorithm  can  be  used  to  identify  failures  for  all  EKF  models.  The  CSPR  filter  has 
been  designed  for  the  specific  NRS  model  developed  at  AFIT.  Fundamentally,  the  CSPR 
filter  is  an  ad-lioc  identification  algorithm  that  exploits  the  engineering  insight  developed 
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through  rigorous  failure  testing  of  a  filter  model.  The  criteria  for  distinguishing  the  failure 
typo  ill  the  residuals  is  presented  in  Section  3.-1.4. 

2.3.4  Thre.'ihold  Selection  and  Filler  Tuning.  Threshold  choosing  is  a  trade¬ 
off  between  several  performance  parameters  to  gain  the  best  FDl  for  the  system.  The 
performance  parameters  that  must  be  balanced  are  false  alarm  rate,  detection  delay,  and 
missed  failures.  If  the  threshold  value  is  high,  the  false  alarm  rate  will  be  low,  wdiilc 
the  detection  delay  and  the  missed  failure  rate  will  be  high.  If  the  threshold  value  is 
lower,  the  false  alarm  rate  will  increase,  while  the  detection  delay  and  missed  failure  rate 
will  decrease.  The  system  dynamics  must  also  be  taken  into  account  when  choosing  a 
threshold.  A  highly  dynamic  system  will  require  a  higher  threshold  than  a  benign  system 
to  maintain  an  acceptable  false  alarm  rate.  In  the  end,  a  balance  is  achieved  between  the 
performance  parameters  that  yields  the  best  possible  FDl  for  the  problem  at  hand.  The 
threshold  choices  made  for  the  MNRS  are  discussed  in  Chapters  III  and  IV. 

The  tuning  of  the  Kalman  filter  can  also  br  varied  to  increase  FDl  ability.  By  altering 
the  tuning  of  the  Kalman  filter,  the  residuals  can  become  more  sensitive  to  failures.  The 
effect  of  changing  the  tuning  can  be  seen  in  Equation  (2.29).  If  the  value  of  R  were  to 
decrease,  the  magnitude  of  the  Chi-Square  test  would  actually  be  increased  since  the  inverse 
of  the  covariance  is  used  in  the  Chi-Square  computat'on.  Equation  (2.30).  Therefore,  it  is 
possible  to  make  a  system  more  sensitive  to  failures  by  adjusting  the  tuning.  Yet  by  altering 
the  tuning,  the  filter  will  no  longer  be  constructed  to  yield  the  optimal  navigation  solution, 
i.e.,  best  state  estimates.  Therefore  varying  the  tuning  parameters  is  not  implemented  to 
improve  the  ability  of  the  FDl  algorithms.  This  research  maintains  the  most  accurate 
navigation  solution  from  the  MNRS  model. 

2.4  Chapter  Summary 

Chapter  II  presented  the  Kalman  filter,  the  Clu-Sqnare  test,  and  the  GLR  test  in 
support  of  the  MNRS  failure  detection  and  isolation  algorithm.  The  first  theory  presented, 
the  Kalman  filter  theory,  will  be  more  deeply  explored  in  the  beginning  of  Chapter  III  with 
the  presentation  of  the  navigation  models.  The  use  of  the  two  failure  algorithms  will  also 
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be  explored  in  Chapter  III  with  a  description  of  the  implementation  of  the  MNRS  FDI 
algorithm. 


HI.  Navigation  and  Failure  Models 


This  chapter  describes  the  models  used  for  the  computer  simulation  of  the  MNRS 
FDIR  algorithm.  The  chapter  begins  with  a  high-level  description  of  the  MNRS  and  its 
major  .sub-components.  Following  this  introduction,  the  NRS  filter  is  described.  The 
description  of  the  NRS  filter  focuses  on  the  implementation  of  the  navigation  models  in 
the  MSOFE  software  [13].  After  the  NRS  filter  description,  the  implementation  of  the 
failure  models  is  presented.  The  chapter  concludes  with  a  discussion  of  the  MNRS  filter 
selection  algorithan. 

3. 1  The  MNRS  Model  Description 

Figure  3.1  reviews  the  major  sub-components  within  the  MNRS.  To  the  far  left  in 
Figure  3.1,  the  GPS  and  RRS  measurement  sources  can  be  found.  These  two  navigation 
aids  distribute  unique  sets  of  measurement  information  to  each  of  the  ten  NRS  extended 
Kalman  filters.  Table  1.1  provides  an  exact  list  of  the  measurement  signals  each  NRS  filter 
receives.  The  navigation  solution  comes  from  the  INS.  Using  the  information  f'^ctn  the 
GPS,  RRS,  and  INS,  each  NRS  filter  calculates  its  best  estimate  of  the  navigation  errors 
made  by  the  INS.  The  ten  chi-square  tests  monitor  the  residuals  of  all  the  NRS  fill, ere  and 
pass  on  the  best  navigation  solution  from  the  bank  of  NRS  filters.  When  the  chi-square 
test  declares  that  a  measurement  signal  has  been  corrupted,  the  navigation  correction 
switches  to  the  unaffected  filter.  The  Chi-Square  test  also  passes  on  the  identity  and  the 
estimate  of  failure  time  to  the  matching  filter.  The  matching  filter  then  estimates  the  type 
of  failure.  This  brief  overview  shows  how  the  INS,  the  GPS  receiver,  the  RRS  recei’^er, 
the  NRS  EKFs,  the  chi-square  tests,  and  the  matching  filter  all  work  together  to  produce 
a  navigation  solution  that  is  robust  against  failures  in  the  GPS  and  RRS  measurement 
signals. 

While  the  mc.jor  focus  of  this  thesis  is  the  FDIR  capability  of  the  MNRS,  the  quality 
of  the  navigation  system  fundamentally  rests  on  the  ability  of  each  NRS  filter  to  provide  an 
accurate  estimate  of  the  errors  committed  by  the  INS  in  calculating  its  navigation  solution. 
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The  next  section  will  fully  develop  the  NRS  extended  Kalman  filter  equations  and  their 
implementation  in  the  MSOFE  software. 


3,2  The  NR,S  Computer  Model 

The  information  and  data  presented  in  this  thesis  has  been  accomplished  entirely 
through  computer  simulation.  The  computer  modelling  of  the  NRS  system  is  divided  into 
two  portions,  the  truth  mode!  and  the  filter  model.  The  truth  model  is  a  computer-generated 
real  world  for  the  NRS  filter.  The  truth  model  generates  such  things  as  the  measurement 
updates  for  the  NRS  filter,  the  true  flight  profile  of  the  aircraft,  and  a  state  variable  baseline 
for  evaluating  filter  performance.  The  truth  model  consists  of  95  error  states  about  their 
nominal  values.  The  filter  model  represents  the  NRS  model  in  its  functional  form.  The 
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filter  model  is  a  15-state  extended  Kalman  filter  that  has  been  developed  through  order 
reduction  of  the  95-state  truth  model. 

The  block  diagram,  Figure  3.2,  explains  how  the  filter  and  truth  models  interact 
in  the  MSOFF  computer  simulation.  PROFGEN  provides  a  simulated  flight  profile  and 
ORBIT  generates  GPS  satellite  constellation  positions.  With  this  information,  the  truth 
model  is  able  to  simulate  the  real  world  INS  navigation  solution  x  +  ix/.vs  and  generate 
the  real  woiid  GPS  and  RRS  measurements.  Raps  a.nd  Rrrs  respectively.  The  NRS  filter 
in  Figure  3.2  is  represented  by  the  extended  Kalman  filter  block.  The  corrections  from  the 
NRS  filter  are  subtracted  from  the  INS  navigation  solution  to  generate  the  best  possible 
navigation  solution  available,  x  =  a;  +  —  bi.  Now  that  the  MSOFE  implementation  of 

the  NRS  filter  has  been  explained,  the  truth  and  filter  models  for  the  GPS,  RRS,  and  INS 
subsystems  will  be  described. 


X 


X 


Figure  3.2  Truth  and  Filtc  Model  Block  Diagram 
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3.S  MRS  Model  Description 

This  section  presents  the  truth  and  the  filter  model  EKF  propagation  and  measure¬ 
ment  equations  (Equations  (2.9)  and  (2.U),  respectively).  The  presentation  will  be  divided 
up  by  navigation  subsystems.  First  the  INS  portion  of  the  equations  will  be  presented,  then 
the  RRS,  followed  by  the  GPS.  Furthermore,  before  the  different  navigation  subsystems 
are  individually  described,  the  high-level  state  and  measurement  equations  are  provided 
for  the  NRS  filter  followed  by  the  truth  model. 

Equations  (3.1)  and  (3.2)  show  how  the  different  navigation  subsystem  models  com¬ 
bine  to  form  a  single  NRS  filter  model: 


FiriSf 

0 

0 

Sxf  = 

0 

Frrsj 

0 

6Xf  + 

WrrSj 

0 

0 

FgpSj 

^GPSj 

^INS, 

V/N4V 

Szf  = 

Hrrsj 

Sxf  -h 

Hops, 

VqPSj 

(3.2) 


As  stated  earlier,  the  overall  filter  model  consists  of  15  states;  11  INS,  2  RRS,  and  2 
GPS  states.  Table  A. 5  in  Appendix  A  provides  a  description  of  the  15-state  vector,  6'x/, 
implemented  in  the  filter  model.  Reference.s  to  further  descriptions  of  the  sub-matrices 
in  the  filter  equations  can  be  found  in  Table  3.1.  It  should  be  iioted  that  the  barouietric 
aliimeter  and  velocity  aiding  measurements  are  considered  to  be  INS  measurements,  while 
the  GPS  and  RRS  range  measurements  are  the  respective  updates  for  the  GPS  and  RRS. 

The  propagation  and  measurement  equations  for  tne  NRS  truth  model  is  presented 
in  similar  fashion  below: 


^Filter 

FiNSu 

0 

0 

0 

Fins,:, 

0 

0 

Sxt  + 

’’XlNS, 

0 

0 

Frps, 

0 

'^rrs. 

0 

0 

0 

Fgps, 

■“'’GPSi 
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Table  3.1  Refeiences  for  the  Sub-Matrices  of  the  NT 

lS  Truth  and  Filter  Models 

Filter  Model  j  l.ocanon  of  Description 

Truth  Model 

Location  of  Description 

F/yvs,  '  Section  3.3. 1.3 

HSSBIHil 

Section  3.3.1.3,3.3.2.1,3.3.3.1 

! 

_ L 

Fins,, 

Section  3. 3. 1.2 

n 

Fins,! 

Section  3. 3. 1.2 

Frrs, 

Section  3. 3. 2. 2 

Frrs, 

Section  3.3.2. 1 

Section  3. 3. 3. 2 

Fops, 

Section  3.3.3. 1 

■MM 

Section  3.3. 1.3 

Wins, 

Section  3.3. 1.2 

Section  3. 3. 2. 2 

Wrrs, 

Section  3.3.2. 1 

Section  3. 3. 3. 2 

Section  3.3.3. 1 

Section  3.3. 1.4 

ffiNS, 

Section  3.3. 1.4 

Section  3. 3. 2. 3 

H  RRS, 

Section  3. 3. 2. 3 

Section  3. 3. 3.3 

Hgps, 

Section  3. 3. 3. 3 

^INS, 

^INS, 

II 

Hrrs, 

Sxt  F 

'<^RRS, 

Hgps, 

Vgps, 

The  JNK.S  truth  model  consists  of  the  original  fifteen  states  of  the  filler  unjuel(iepi'eseiued 
by  Fpiifer  and  WFuter),  augmented  by  additional,  INS,  GPS,  and  RRS  states.  The  total 
number  of  states  for  the  three  navigation  subsystems  is  95;  39  INS  states,  26  RRS  states, 
and  30  GPS  states.  Tables  A.1-A.4,  in  Appendix  A  give  a  full  description  of  each  individual 
state  of  the  truth  model.  Also  Tables  B.1-B.5  and  Tables  B.6-B.7  in  Appendix  B  have  a 
complete  listing  of  the  components  of  the  F  and  the  Q  noise  strengths  associated  with  the 
W  matrices  in  Equation  (3.3). 

While  the  first  fifteen  truth  states  of  the  filter  model  are  nearly  identical  to  the 
first  fifteen  states  of  the  model,  there  is  one  crucial  difference.  The  filter  model  dynamics 
driving  noise  and  measurement  noise  do  not  correlate  with  those  of  the  first  fifteen  states 
of  the  truth  model.  The  filter  model  noise  values  have  been  altered  to  achieve  good  tuning 
against  the  truth  model  [9].  The  following  .sections  will  provide  a  detailed  presentation  into 
the  exact  make-up  of  the  truth  and  filter  model  propagation  and  measurement  equations 
for  all  three  navigation  subsystems. 

3.3.1  The  Inertial  Navigation  System(INS)  Model.  This  section  presents  the 
truth  and  filter  models  used  for  the  INS.  The  INS  model  is  a  strapped-down  wander 
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azimuth  system  that  senses  aircraft  motion  via  gyros  and  accelerometers  and  is  used  as 
the  primary  source  for  navigation.  The  INS  model  has  been  derived  from  the  Litton  93- 
State  model  [4].  First,  the  original  93-state  Litton  model  will  be  presented,  followed  by 
the  reduced-ordered  39-state  truth  and  11-state  filter  models.  After  the  truth  and  filter 
state  equations  have  been  defined,  barometric  altimeter  and  Doppler  velocity  aiding  INS 
measurement  equations  will  be  presented. 

3. 3. 1.1  The  93  State  LN  -93  Eri'or  Model.  The  QG-state  Litton  INS  MSOFE 
computer  model  has  been  generated  by  the  Wright  Labs  Avionics  Directorate  Research 
Group.  Their  development  uses  both  past  AFIT  research  and  Litton  documentation  to 
fine  tune  past  modelling  efforts  [4,  14,  18,  19].  The  93-state  model  generates  a  high  num¬ 
ber  of  documented  error  sources  that  are  found  in  the  Litton  wander- azimuth  LN-93  INS. 
These  errors  are  described  using  six  categories  of  states: 

=  [  <5xf  dxf  6xJ^  6x^  6x^  SxJ  1^  (3.5) 

where  ix  is  a  93  x  1  column  vector  and: 


Sxi  represents  the  “general”  error  vector  containing  13  position,  velocity,  attitude, 
and  vertical  channel  errors. 

6X3  consists  of  16  gyro,  accelerometer,  and  baro-altimeter  exponentially  time- 

A 

v^v/x  X  vv-vi.  v^xxv/i.v7)  wxivi  TjiV'ixvA  X  xxv^ov^  clo  moo  viGltJX 

Markov  processes  in  the  truth  (system)  model. 

Sx^  represents  gyro  bias  errors.  These  18  states  are  modeled  as  random  constants 
in  the  truth  model. 


Sx^  is  composed  of  the  accelerometer  bias  error  states.  These  22  states  are  modeled 
in  exactly  the  same  manner  as  the  gyro  bias  states. 

Sx^  depicts  accelerometer  and  gyro  initial  thermal  transients.  The  6  thermal  tran¬ 
sient  states  are  first  order  Markov  processes  in  the  system  model. 
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Sxe  models  the  gyro  compliance  errors.  These  18  error  states  are  modeled  as  biases 
in  the  system  model. 

The  93-State  Litton  model  state  space  differential  equation  is  given  by: 


6x^ 
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A  full  description  of  the  sub-matrices  for  this  equation  is  given  in  the  Litton  LN-93  manual 
[4].  This  large  state  model  represents  the  most  accurate  model  available  for  the  LN-93 
navigation  errors. 


3.3. 1.2  The  39~State  INS  Truth  Model.  While  the  93-state  model  is  a  very 
accurate  representation  of  the  INS  error  characteristics,  the  high  dimensionality  of  the 
state  equations  makes  the  model  impractical  for  failure  detection  analysis.  Previous  AFIT 
theses  have  demonstrated  that  reduced-ordered  truth  models  can  be  used  in  place  of  the 
93-State  model  without  losing  a  significant  degree  of  accuracy  [6,  14].  Therefore  the  INS 
truth  model  has  been  reduced  to  a  39-state  model.  The  reduced-ordered  model  retains 
only  the  truly  essential  states  from  Equation  (3.6).  The  truth  model  state  space  equation 
is  defined  in  Equation  (3.7); 
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k  4  ; 
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It  should  be  noted  that  the  INS  truth  state  vector  6x,  is  a  39-state  vector.  The  four 
components  of  6x  do  not  directly  correlate  to  the  first  four  components  of  the  93-3tate 
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Litton  model.  For  a  complete  listing  of  the  39  .states  and  how  they  relate  to  those  in  the 
Litton  model,  see  Tables  A.l  and  A.2  in  Appendix  A. 

3.3. 1.3  The  11 -State  INS  Filter  Model.  The  IKS  filter  model  retains  the 
essential  states  from  the  39 -state  truth  model.  Through  j;  a:A  AFIT  research,  the  11- 
state  INS  filter  has  been  shown  to  perform  adequately  when  gi  ven  frequent  GPS  and  RRS 
measurement  updates  [14,  19].  Table  A.5  in  Appendix  A  sh  jws  ihe  11  states  used  for  the 
INS  filter  model.  Dynamics  driving  noise  has  also  been  addc'i  to  every  state  to  compensate 
for  the  order-reduction  of  the  model.  The  final  INS  filter  state  dynamic  driving  noise  values 
can  be  found  in  Table  B.8  of  Appendix  B. 

3. 3. 1.4  INS  Measurement  Models.  The  two  INS  mcasuiements  that  are 
used  to  update  the  filter  are  the  barometric  altimeter  and  the  Doppler  based  velocity. 
Both  these  signals  are  used  to  correct  for  inherent  instabilities  in  the  filter.  First  the 
altimeter  measurement  will  be  presented,  followed  by  the  Doppler  based  velocity  measure¬ 
ment.  It  should  be  noted  that  since  the  NRS  filter  is  an  error  state  filter,  it  is  necessary  to 
develop  difference  measurement  update  equations  for  all  the  measurements.  The  altime¬ 
ter  measurement  equation  is  based  on  the  difference  between  the  INS-predicted  altitude, 
AltiNs  and  the  barometric  altimeter-predicted  altitude  AlUar'- 

^^Att  =  AltjNS  ~  Altiar 

Therefore  it  is  necessary  to  develop  the  two  separate  measurement  signals  that  will  be 
differenced  to  attain  the  proper  measurement  update  for  the  error  state  filter.  The  INS- 
predicted  altitude  is  the  sum  of  the  true  altitude,  hj,  and  the  INS  error  in  vehicle  altitude 
above  the  reference  ellipsoid,  6h.  The  barometric  altimeter  reading  is  modelled  as  the  sum 
of  the  true  altitude,  /i,,  the  total  error  in  the  barometric  altimeter,  Shs,  and  a  random  mea¬ 
surement  noise,  v.  The  difference  measurement  update  signal  is  formed  in  Equation  (3.9) 
by  .ubtracting  the  INS-predicted  altitude  from  the  barometric  altimeter  altitude: 

^^Alt  — 


Ali/jVS  ~  Altsar 


[ht  +  6/i]  —  [/if  +  ^/ifl  +  'i] 


=  6h-  SfiB  +  V  (3.9) 

A  perfect  Doppler  system  provides  velocity  aiding  to  the  INS  based  on  assumption  12 
in  Chapter  I.  The  Doppler  measurement  has  been  added  to  lend  numerical  stability  to  the 
NRS  filter.  A  simple  model  is  assumed  for  the  Doppler  measurement.  All  three  channels 
(north,  east,  and  up)  are  represented  by  the  difference  between  the  truth  state  velocity 
error,  <5Vi,,  and  the  filter  sta,te  velocity  error,  6Vi,  as  shown  in  Equation  (3.10). 

izi  =  6Vi^  —  6Vi  where  i  =  x,y,z  (3.10) 

Although  this  model  seems  somewhat  unrealistic,  in  that  it  provides  the  filter  with  an 
ideal  difference  measurement  for  velocities,  it  does  not  skew  the  performance  of  the  FDI 
algorithm  because  these  measurements  are  not  used  in  the  FDI  calculations.  The  simplistic 
model  is  being  used  until  a  more  accurate  model  can  be  developed.  Use  of  this  model  also 
allows  the  results  of  this  thesis  to  be  directly  compared  to  past  AFIT  research  [14,  17,  18, 
19]. 

There  is  no  difference  in  the  form  of  the  INS  truth  and  the  filter  model  measurement 
equations.  Both  use  the  same  states  to  create  the  INS  difference  measurements.  The 
only  distinction  lies  in  the  measurement  noise  values  for  each  of  the  two  equations.  The 
truth  and  filter  measurement  noise  values  are  located  in  Table  B.9  of  Appendix  B.  This 
completes  the  presentation  of  the  INS  truth  and  filter  state  equations  as  well  as  the  INS 
measurement  equations.  The  next  section  will  develop  similar  equations  for  the  ground- 
based  transponder  system  used  in  this  thesis. 

3.3.2  The  Range /Range-Bate  SysteTn(RRS)  Model.  The  RRS  system  is  the  pri¬ 
mary  CIGTF  ground-based  transponder  system  that  has  been  installed  for  testing  and 
evaluating  navigation  equipment  [14,  18).  The  RRS  interrogates  the  transponders,  collect¬ 
ing  the  electro-magnetic  (EM)  signals  they  emit.  These  signals  give  the  user  the  range  to 
the  transponder.  In  this  thesis,  the  navigation  information  passed  to  the  NRS  filters  is  the 
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range  t,o  five  transponders  and  the  known  location  of  those  transponders.  As  done  with 
the  INS  models,  first  the  RRS  truth  model  state  equations  will  bo  presented,  followed  by 
the  filter  model  state  equations,  and  finally  the  measurement  update  equations. 


3.3.2. 1  26-State  RRS  Truth  Model.  The  RRS  truth  model  contains  26 
states  to  simulate  the  real  world  errors  that  exist  in  the  transponder  system.  The  first  two 
error  states  are  common  error  stales,  i.e.,  these  errors  are  common  to  all  of  the  transpon¬ 
ders.  The  two  common  states  for  the  transponders  are  a  result  of  errors  in  user  hardware. 
They  appear  as  bias  terms  and  are  modeled  as  random  constants.  These  state  equations 
are  given  by: 


0  0 

SR, 

< 

Svii 

\  J 

0  0 

i 

where 


SRi  =  R,ange  error  due  to  equipment  bias 

Svi,  =  Velocity  error  due  to  equipment  bias 


The  initial  conditions  for  the  truth  model  states  were  chosen  to  be  consistent  with  CIGTF 
and  previous  AFIT  research  [1  f,  17,  18,  19]  and  are: 


and 


’  SR,{t,)  ' 

0 

Sv,{to) 

0 

1/^  0  1 

0  10“‘‘/t^/scc^  J 


(3.12) 


(3.13) 


Along  with  the  two  common  error  states  for  the  transponder,  each  of  the  transponder 
signals  has  four  error  states  to  model  the  unique  errors  of  tiiat  specific  transponder  unit. 
These  errors  represent  the  error  in  the  surveyed  position  (x,  y,  and  z)  of  the  transponder’s 
location  and  the  atmospheric  propagation  delay  between  the  transponder  and  the  receiving 
aircraft.  The  position  errors  are  modeled  as  random  constants  and  the  atmospheric  error 
is  represented  by  a  first  order  Markov  process.  The  state  equations  for  these  error  sources 
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are  shown  below  where  ?  represents  the  various  transponders  (1-6): 
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(3.14) 


The  initial  conditions  for  these  states  were  chosen  to  be  consistent  with  previous  AFIT 
research  [14,  17,  18].  The  initial  mean  and  variance  for  the  truth  model  are  defined  below. 


Fr,y,2,atrn(^o)  —  b 


(3.15) 


(^o)  — 


25fP  0  0  0 

0  25ft^  0  0 

0  0  25ff  0 

0  0  0  100/f^ 


(3.16) 


The  truth  model  dynamics  driving  noise  that  has  been  implemented  for  the  transponder 
error  states  was  provided  by  Holloman  test  facilities  through  past  AFIT  research  [14,  17, 
18,  19] .  The  mean  and  variance  of  the  dynamic  driving  noise  are: 


E  {iyr,y..,,„,m(<)j  =  0 


(3.17) 


E  {u-’r,i,,,,a,m(<)<v,^,ann(<  +  ^)}  = 


0  0  0  0 
0  0  0  0 
0  0  0  0 
0  0  0  "  ' 


300  J 


^(r) 


(3.18) 


respectively,  with  10~^°{^.  Therefore  the  truth  model  will  consist  of  26  states,  two 

common  user  error  states  plus  six  sets  of  four  unique  transponder  error  states.  It  should 
be  noted  that  the  truth  model  as  simulated  will  propagate  six  sets  of  unique  transponder 
error  states,  yet  only  five  are  used  by  each  NRS  filter.  The  extra  state  has  been  maintained 
to  ease  the  implementation  of  the  MNRS  model.  However  it  is  importtuit  to  understand 
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that  each  individual  NRS  filter  receives  only  five  RRS  transponder  signals.  This  completes 
the  description  of  the  RRS  truth  model.  Next  the  RRS  filter  model  will  be  presented. 


3. 3. 2. 2  The  2-State  RRS  Filter  Model.  Research  at  AFIT  has  shown  that 
retaining  only  the  first  two  states,  which  are  common  to  all  the  transp  3nders,  provides  good 
filter  performance  [19].  These  states  are  the  range  and  velocity  errors  due  to  equipment 
bias  and  are  represented  as  6Ri,  and  Sv;,  in  Equation  (3.11).  To  compensate  for  the  removal 
of  the  other  states  and  to  prevent  EKF  gains  from  going  to  zero,  dynamics  driving  noise 
has  been  added  to  each  of  the  two  RRS  filter  states. 


(3.19) 


The  initial  mean  and  variance  for  the  filter  model  is  assumed  to  be  zero  for  these  tv/o  states. 
Filter  tuning  accounted  for  the  exact  magnitudes  used  for  the  strengths  of  the  dy^namics 
driving  noise,  and  The  final  values  implemented  can  be  found  in  Table  B.8  of 
Appendix  B. 


3. 3.2. 3  RRS  Measurement  Model.  Each  NRS  filter  will  receive  five  different 
measurement  update  signals  from  the  five  different  transponut,  iocations.  This  section 
describes  the  mep.sureroent  equations  for  the  RRS  transponder  updates.  Each  equation  for 


tne  transponaer  updates  is  lueiiticai  in  luriii.  rirsi  me  vruni  muuei  measiueiuem.  equaiiou 
will  be  fully  developed,  followed  by  a  brief  description  of  the  reduced-order  filter  model 
measurement  equation. 


The  RRS  difference  measurement  is  generated  by  forming  two  independent  measure¬ 
ments  of  the  range  from  the  transponder  to  the  aircraft.  The  EKF  then  takes  the  difference 
of  these  two  measurements  to  form  6z.  The  two  range  measurements  differenced  are  the 
INS-compute.d  range  [Raws)  the  RRS- calculated  range,  (R-Rjis): 


—  R/ns  ~  Rrrs 


(3.20) 
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The  RRS  range  measurement,  Rrhs  is  the  sum  of  the  true  range  from  the  transponder  to 
the  aircraft  and  the  errors  inherent  in  the  measurement  signal; 

■RjJfiS  =  +  SRatm  +  6Rb  +  V  (3.21) 


where 
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Rt 

^Ratm 

SRb 

V 


RRS  range  measurement,  from  transponder  to  user 

true  range,  from  transponder  to  user 

range  error  due  to  atmospheric  delay 

error  due  to  equipment  bias 

zero-mean  white  Gaussian  measurement  noise 


The  second  source  of  range  information  is  provided  by  the  INS.  The  NBS  takes  the 
INS  computed  position,  Xu  and  subtracts  the  known  transponder  nosition,  Xt-  Equa¬ 
tion  (3.22)  shows  the  calculation  of  the  Rjns- 


It  should  be  noted  that  both  Xr  and  Xu  represent  position  vectors  in  the  earth-centered 
earth-fixed  (ECEF)  frame.  While  Equation  (3.22)  provides  the  second  source  of  transpon¬ 
der  range  information,  this  equation  is  not  a  function  of  the  EKE  error  state  variables. 
Therefore  it  is  necessary  to  rewrite  Equation  (3.22)  in  the  following  form. 


+  iVu  -  Vr  ?  + 


(3.23) 


Equation  (3.23)  is  equivalent  to  Equation  (3.22).  This  new  equation  will  now  be  ap¬ 
proximated  to  generate  a  relationship  for  Rins  that  is  a  function  of  the  EKE  error  state 
variables.  Based  on  assumption  11  from  Chapter  1,  Equation  (3.23)  can  be  approximated 
and  rewritten  in  terms  of  the  true  range  and  a  truncated  first-order  Taylor  series,  with 
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perturbations  representing  the  errors  in  A'y  and  A'y'. 


+ 


+ 


dX^ 


■  6X^ 


(3.24) 


The  final  expression  for  Rins-,  Equation  (3.25),  is  found  by  evaluating  the  partial  deriva¬ 
tives  in  Equation  (3.24).  It  should  be  noted  that  Equation  (3.25)  is  a  function  of  Sx^, 
6z^,  Sx^,  6y^,  and  6z^.  These  variables  can  be  directly  transformed  into  the  state 
variables  in  the  EKF  truth  state  equation. 
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The  actual  difference  equation.  Equation  (3,26)  is  now  formed  by  taking  the  difference 
between  Rjms  and  Rrrs 
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(3.26) 


The  equation  for  the  difference  measurement.  Equation  (3.26),  is  the  complete  form  of 
the  ineasureinent  for  the  truth  model.  In  the  above  equation,  ^zc/,  6yi:,  and  6zu  can  be 
translated  through  a,n  orthogonal  transformation  into  the  state  variables  60^,  66^,  and  662 
defined  as  truth  model  states  in  Table  A.l  of  Appendix  A  [l]. 

The  actual  measurement  equation  that  is  used  for  the  reduced -order  NB.S  filter  does 
not  retain  the  terms  6x^.,  Sy.^,,  and  since  the  leduced-ordered  model  does  not  contain 
these  states.  Theiefore  with  those  values  set  to  zero  Equation  (3.27)  is  the  filter  model 
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measurement  equation  for  the  NRS  filter. 


^^RRSj  —  ^iNs 
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The  filter  mea,surement  noise  strength,  R  will  be  tuned  to  attain  adequate  performance 
despite  the  reduction  in  order  from  the  truth  model  and  the  Taylor  series  approximation. 
Table  B.9  in  Appendix  B  contains  a  complete  listing  of  the  measurement  noist  values 
for  both  the  filter  and  the  truth  model  models.  This  ends  the  description  of  the  RR3 
navigation  subsystem.  Next  the  GPS  navigation  equations  are  presented. 

3.S.3  The  Global  Positioning  System( GPS)  Model.  The  third  and  final  navigation 
system  is  based  on  EM  signals  transmitted  from  orbiting  GPS  satellites.  Although  similar 
in  concept  to  the  RRS,  the  GPS  is  modeled  somewhat  differently.  This  model  has  been 
developed  through  research  at  AFIT,  and  many  of  its  fundamental  concepts  axe  addressed 
in  a  variety  of  sources  [7,  14,  17,  18].  GPS  is  similar  to  the  RRS  in  that  it  generates 
navigation  information  by  acquiring  the  range  to  multiple  satellites  of  knovm  position. 
The  navigation  information  pa.ssed  to  each  NRS  filters  is  the  range  to  four  satellites  and 
the  ephemeris  data  position  of  those  four  satellites  [7].  The  next  three  sections  will  present 
all  the  necessary  equations  to  define  the  GPS  truth  and  filter  models  fully. 

3. 3. 3.1  The  30-State  GPS  Truth  Model.  There  are  five  types  of  error 
sources  that  are  modeled  in  the  GPS  truth  model  state  equations.  The  first  two  states 
represent  the  errors  in  the  user  clock  and  are  modeled  as  follows; 

{^Rclku 
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hRclkv  — 


range  equivalent  of  user  clock  bias 


velocity  equivalent  of  user  clock  drift 


^^clku  ~ 


The  initial  state  estimates  and  covariances  for  these  states  were  chosen  to  be  consistent 
with  previous  AFIT  research  [14,  17,  18]  and  are: 
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Because  these  error  sources  are  a  function  of  the  user  equipment,  they  are  common  to 
all  the  satellite  vehicles.  The  remaining  five  sources  of  errors  are  unique  to  each  satellite 
vehicle  (SV),  based  on  their  individual  equipment  and  their  position  with  respect  to  the 
user.  The  first  SV-specific  error  source  is  the  code  loop  error.  Although  the  code  loop  is 
part  of  the  user  equipment  shared  by  all  the  SV’s,  its  error  magnitude  is  relative  to  each 
SV.  The  second  and  third.  SV-specific  errors  are  the  atmospheric  interference  with  the  EM 
signals,  as  related  to  the  ionospheric  and  tropospheric  delay  in  the  signal’s  propagation. 
The  code  loop  error,  tropospheric  delay,  and  ionospheric  delay  are  all  modeled  as  first 
order  Markov  processes  with  time  constants  shown  in  Equation  (3.31),  consistent  with 
previous  AFIT  research  [18,  14,  19],  All  three  are  driven  by  zero-mean  white  Ga.ussian 
noise  with  strengths  shown  in  Equation  (3.-34).  The  fourth  SV-specific  error  source  is  due 
to  inaccuracies  in  the  docks  on  board  the  SV’s,  and  the  final  error  source  is  based  on  line- 
of-sight  errors  between  the  SV’s  and  the  receiver.  The  model  for  these  states  is  shown  in 
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Equation  (3.31), 
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(3.31) 

where  the  initial  covariances  for  the  states  is  given  by; 
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and  mean  values  and  strengths  of  the  dynamics  driving  noise  are  given  by; 
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A  quick  reference  of  the  truth  model  non-zero  GPS  and  RRS  dynamics  matrix  components 
is  provided  in.  Tables  B.h  and  B.5  of  Appendix  B.  This  ends  the  description  of  the  30-state 
truth  model.  Now  the  filter  model  will  be  presented. 


3. 3. 3. 2  The  2-State  GPS  Filter  Model.  Various  research  efforts  have  shown 
that  two  states  provide  a  sufficient  model  for  GPS  [14,  6],  The  primary  argument  is  that 
the  errors  modeled  by  the  other  28  states  are  small  when  compared  to  the  two  states 
common  to  all  SV’s,  By  adding  dynamics  driving  noise,  Q,  and  re-tuning  the  filter,  the 
overall  performance  of  che  NRS  can  be  maintained  with  the  significantly  reduced-order 
model  of  Equation  3.35; 


P-ctku 

^'Pclku 


6Rclku 

... 

,  J 

(3.35) 


The  values  implemented  for  the  dynamics  driving  noise  strengths  can  be  found  in  Table  B.8 
of  Appendix  E.  It  should  be  noted  that  iir  the  tuning  pro-.ess,  the  measurement  noise 
covariance  values  R  have  also  been  adjusted  to  achieve  adequate  tuning  of  the  filter  [9]. 
This  completes  the  description  of  the  GPS  filter  model.  The  next  section  presents  the  GPS 
measurement  equations  for  both  the  truth  and  the  filter  iiiodels. 


3. 3. 3. 3  CFS  Measurement  Model.  There  are  four  GPS  measurement  up¬ 
dates,  one  for  each  of  the  satellite  range  .signals  received  by  the  NB.S  filter.  These  mea¬ 
surement  updates  are  once  again  difference  measurements  similar  in  structure  to  the  RRS 
difference  measmements,  First  the  CPS  truth  model  difference  measurement  will  be  fully 
presented,  followed  by  a  brief  description  of  the  filter  measurement.  The  GPS  diffeienco 
measurement  is  formed  by  taking  the  difference  of  the  INS- calculated  pseudorauge,  PRu^s 
and  the  actual  pseudorange,  PRops'. 


—  PILIN'.-  —  PRofs 
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(3.36) 


The  real  pseudorange,  PRqps  is  the  sum  of  the  true  range  from  the  user  to  the  satellite 
plus  all  the  errors  in  the  pseudorange  signal  propagation. 
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GPS  pseudo  range  measurement,  from  SV  to  user 
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true  range,  from  SV  to  user 
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range  error  due  to  code  loop  error 

bRirop 

range  error  due  to  tropospheric  delay 

bRion 

range  error  due  to  ionospheric  delay 

bRsclk 

= 

range  error  due  to  SV  clock  error 

bRuclk 

= 

range  error  due  to  user  clock  error 

V 

ZZ 

zero-mean  white  Gaussian  measurement  noise 

The  second  source  of  a  range  measurement  is  the  INS  itself,  PRins-  The  derivation  of 
PRjns  parallels  that  of  Ri^s  from  Section  3.3.2. 3.  PRi^s  is  the  difference  between  the 
N  RS-calculated  position,  Xu,  and  the  satellite  position  from  the  ephemeris  data  Xs-  This 
difference  vector  is  represented  below  in  the  ECEF  frame: 
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An  equivalent  form  for  Equation  (3.38)  is: 


(3.38) 


=  ^/i^-^sy  +  iyu-ysy  +  i^u-^sf 


(3.39) 


Based  on  assumption  11  from  Chapter  I,  Equation  (3.39)  can  be  iipproximated  and  rewrit¬ 
ten  in  terms  of  the  true  range  and  a  truncated  first-order  Taylor  series,  with  perturbations 
lepresenting  the  errors  in  X^j  and  X^: 
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dX^ 


(Ar^,Xjj)nofn 


(3.40) 


The  solution  for  Rn^s  is  found  by  substituting  Equation  (3.39)  into  Equation  (3.40)  and 
evaluating  the  partial  derivatives  to  get: 


Finally,  the  GPS  pseudorange  truth  model  difference  measurement  is  given  as: 


-  -  [l]^/2,rop  -  [l]SRion 

-  [I'lSRi^cik  ~  ^  (3-42) 


Similar  to  the  RRS  truoh  model  measurements,  the  user  position  errors  in  Equation  (3.42) 
can  be  transformed  into  the  first  three  states  of  the  filter  or  truth  model  using  an  orthogonal 
transformation  [ij. 

The  filter  model  for  the  GPS  measurement  updates  can  be  derived  in  similar  fashion 
as  the  RRS  filter  measurement  updates.  Since  the  filter  model  does  not  contain  the  states 
for  the  errors  in  the  satellite  position,  these  terms  are  removed  from  the  equation.  The 
filter  model  measurement  equation  can  therefore  be  written  as 


-  -  V 


(3.43) 
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The  filter  measurement  noise  strength,  R  will  be  tuned  to  attain  adequate  performance 
despite  the  reduction  in  order  from  the  truth  model  and  the  Taylor  series  approximation. 
The  measurement  noise  variances  for  both  the  filter  and  the  truth  model  equations  are 
provided  in  Table  B.9  of  Appendix  B.  This  completes  the  description  of  the  GPvS  mea¬ 
surement  equations  and  the  entire  NRS  filter  and  truth  model  equations.  More  detail  can 
be  found  on  these  equations  in  past  AFIT  research  [14,  18,  19].  The  following  sections  will 
present  the  failure  models  implemented  in  this  thesis. 


34  Failure  Models 

The  models  explained  previous  to  this  section  do  not  incorporate  the  occurrence  of 
failures.  This  section  explains  how  failures  are  added  to  the  simulation,  and  clarifies  the 
matching  filter  algorithms.  This  section  begins  with  a  restatement  of  the  exact  failures  that 
are  modelled.  Next,  the  necessary  changes  to  the  truth  model  for  generating  simulated 
failures  arc  presented.  Finally  the  two  matching  filters  are  defined. 


3.4J  Description  of  the  Failures.  This  section  explains  the  mathematical  models 
for  the  three  types  of  failures;  step  bias,  ramp  offset,  and  increased  measurement  noise. 
The  failures  are  restricted  to  single  failures  of  a  GPS  satellite  or  RRS  transponder  range 
measurement.  Doppler  failures  and  altimeter  failures  are  not  considered  in  this  thesis  to 
maintain  a  reasonable  number  of  multiple  models  in  the  simulation.  Therefore  only  a  single 
satellite  or  ti  aiispoudei  measuieiuoiit  is  afiecieJ  during  any  one  simulation  run.  Satellite 
3  and  transponder  1  have  been  chosen  at  random  to  be  the  signals  altered  by  the  step, 
ramp,  and  noise  failures.  The  relative  geometry  of  all  the  range  measurements  is  presented 
in  Chapter  IV.  Detailed  mathematical  definitions  are  now  presented  for  these  three  failure 
types. 

The  step  bias  is  modelled  as  a  scalar  increase  in  the  range  measurement  of  a  satellite 
or  a  transponder.  The  bias  will  begin  at  time  tf^u,  and  continue  for  a  length  of  time, 
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iungth-  Therefore,  for  all  time,  the  step  bias  failure  is  defined  as, 


b{ti) 


0  if  ti  <  tfau 

Ibjc  if  ^  ^  f'Jail  H“  ^length 

0  if  tj  ^  ijait  T  ^length 


(3.44) 


where 

biU)  = 

Step  Bias  Failure 

bk 

Magnitude  of  the  Step  Bias 

^fait 

Initial  time  of  a  failure 

^Ungth  — 

Time  duration  of  the  failure 

The  definition  for  the  ramp  offset  is  similar  to  that  of  the  step  bias.  The  ramp  offset 
also  begins  at  time  t/„,/  and  continues  for  duration  tungth-  Yet  the  ramp  offset  is  a  scalar 
magnitude  that  will  actually  increase  during  the  duration  of  the  failure.  Equation  (3.45) 
defines  the  ramp  offset  for  all  time  tj. 
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(3.45) 


where 


r{ti) 

Ramp  Offset  h'ailure 

rk  = 

Slope  of  the  Ramp  Offset 

— 

Initial  time  of  a  failure 

^length 

Time  duration  of  the  failure 

The  increase  in  the  measurement  noise  failure  is  inherently  different  from  the  other  two 
failures.  The  noise  failure  increases  the  variance  of  the  pre-existing  Gaussian  white  mea¬ 
surement  noise  between  times,  tjan  and  </«,(  +  Equation  (3.46)  shows  how  the  failed 
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measurement  noise  term  is  changed  to  reflect  the  existence  of  the  failure: 


if  ti  <1  tjail 

7lfcU(t,) 

if  ^  ^  ^length 

V{ti) 
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(3.46) 


where 


v{ti) 

nk 

ijail 

^Unstk 


Measurement  Noise  for  the  Failed  Satellite  or  Transponder  Signal 

Scalar  Measurement  Noise,  No  Failure 

Strength  of  the  Measurement  Noise  Failure 

Initial  time  of  a  failure 

Time  duration  of  the  failure 


These  three  failure  definitions  define  the  scope  of  the  failure  analysis  for  this  thesis.  It  is 
now  necessary  to  integrate  these  failure  definitions  into  the  previously  defined  NRS  truth 
model. 

3.4-2  Failures  in  the  Truth  Measurement  Equation,  Up  to  this  point,  the  truth 
model  for  the  NRS  filters  has  been  defined  without  failure  occurrences.  To  test  the  validity 
of  the  failure  detection  algorithms,  it  is  necessary  to  alter  the  truth  model  so  that  failures 
will  occur.  To  change  the  truth  model,  single  failures  arc  added  to  specific  measurement 
updates  over  a  predetermined  window  of  time.  For  this  work,  all  failures  occur  at  time 
ti  =  20005,  and  continue  for  1000s  (s  =  seconds). 

Failures  are  added  to  the  scalar  measurement  update  equation  for  the  failed  measure¬ 
ment  signal.  Sections  3. 3.3. 3  and  3. 3. 2. 3  provide  the  definitions  for  the  scalar  measurement 
equations  for  the  satellite  and  transponder  updates,  assuming  no  failure  has  occurred. 
These  equations  are  now  redefined  specifically  for  satellite  3  and  cransponder  1  to  produce 
failures  in  the  truth  model.  Equation  (3.47)  defines  the  new  scal..r  measurement  update 
equation  for  satellite  3; 
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-  [l]iRc,  - 

”  [l]^^5c/fc  -  ~  Mii)  +  H«.)  +  riu)  (3.47) 


The  new  terms  added  to  Equation  (3.47),  fr(ti),  r(<i),  and  U/(<,),  are  defined  in  Equa¬ 
tions  (3.44),  (3.45),  and  (3.46)  respectively.  Within  the  definitions  of  these  three  new 
variables,  the  magnitude  of  the  failures  is  controlled  by  the  scalar  variables  6*,  r*,  and  n*,. 
The  values  used  for  simulation  purposes  in  this  thesis  are  presented  in  Table  3.48 

The  changes  made  to  the  scalar  measurement  equations  for  transponder  1  parallel 
those  for  satellite  3.  The  failed  transponder  equation  is  defined  as, 
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As  before,  the  failure  variables  added  to  the  above  equation  are  defined  in  Equations  (3.44),  (3.45), 
and  (3.46).  Once  again  Table  3.2  contains  the  failure  magnitude  values,  6*,  r*,  and  n*,  for 
each  of  the  simulation  runs.  The  magnitudes  of  the  failures  are  based  upon  an  analysis 


Table  3.2  Definition  of  Failure  Variables  for  each  Simulation  Run 
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of  the  impact  of  the  failures  on  the  filter  residuals.  The  failure  magnitudes  displayed  in 
Table  3.2  are  chosen  high  enough  so  that  the  impact  of  the  failures  on  the  residuals  can 
be  clearly  distinguished  from  failure-free  system  dynamics,  yet  low  enough  not  to  induce 
instants-neoiu.  instabilities  in  the  filter  state  propagation. 
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The  changes  defined  in  this  section  are  the  only  changes  made  to  the  truth  model. 
The  changes  produce  single  failures  (step,  ramp,  and  noise)  in  either  a  single  transponder 
or  satellite  difference  measurement. 


3.4.  ■’i  The  GLR  Failure  Models.  As  defined  in  Section  2. 3. 2.2,  the  GLR  algorithm 
has  been  modified  to  become  a  simple  matching  filter.  This  new  function,  defined  as  T(t,) 
in  Equation  (2.58),  is  referred  to  as  the  modified  GLR  matching  filter.  The  EKF  produces 
almost  all  the  necessary  variables  to  compute  T(L)  in  Equation  (2.58).  However  there  are 
three  variables  that  need  to  be  defined  to  complete  the  matching  filter  description.  First 
the  Chi-Square  test  must  provide  the  identity  of  the  failed  measurement.  This  allows  the 
matching  filter  to  predefine  the  vector  d{ti)  as  dy^{ti).  Therefore  d^[ti)  d  be  defined  as, 


SV"1  SV2  SV3  SV4  TRl 


TR2  TR3  TR4  TRb 


T 


0  0  1  0  0  0  0  0 


(8.49) 


for  the  satellite  failure  runs  and, 


SVl  SV2  SV3  SV4  TRl 


TR2  TR3  TRA  TR5 


0  0  0  0  1  0  0  0 


(3.50) 


fur  traiiSpunder  failure  runs. 

The  other  two  variables  that  must  be  defined  for  the  GLR  matching  filter  are  the 
step  and  the  ramp  failure  models.  These  models  are  closely  related  to  the  definitions  of 
the  failures  in  the  truth  model  (Equations  (3.44)  and  (3.45)).  The  GLR  failure  model  for 
the  step  failure  is  defined  as, 
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(3.51) 
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The  GLR  failure  model  for  th-  rarup  failure  is  derived  similarly  to  the  step  failure 
model.  Equation  (3.52)  gives  the  definition  for  the  GLR  ramp  failure  model: 


^ramp 


iu)  = 


0 

(<.  ~  4) 


if  U  <  Oy. 

if  ti  >  4 


(3.52) 


For  both  the  .step  and  the  ramp  GLR  failure  models,  unity  magnitude  has  been  declared. 
The  GLR  matching  filter  is  merely  attempting  to  determine  the  type  of  failure,  not  its 
magnitude. 


The  estimate  of  the  failure  magnitude  is  calculated  from  Equation  (2.60).  This 
equation  is  rewritten  below. 


s{t„e) 


(3.53) 


To  estimate  the  magnitude  of  the  step  and  the  ramp  failures,  all  the  information  available 
needs  to  be  incorporated  into  this  expression.  Therefore  using  the  known  quantities, 
^j(ep(<i))  and  nramp{U)i  the  step  and  ramp  magnitude  estimates  are  defined  as: 
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for  the  estimate  of  the  step  failure  and; 
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(3.54) 


(3.55) 


for  the  estimate  of  the  ramp  failure.  Depending  upon  the  outcome  of  the  modified  GLR 
matching  filter,  one  of  these  two  estimates  will  provide  an  estimate  of  the  step  or  ramp 
magnitude. 

The  GLR  matching  filter  2dgorithm  has  now  been  completely  defined.  The  following 
section  defines  a  second  matching  filter  algorithm.  In  the  end,  the  results  of  these  two 
matching  filters  will  be  analyzed  to  determine  which  provides  better  failure  type  identifi¬ 
cation  for  the  MNRS  algorithm. 
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3.4-4  ^  CSPR  Matching  Filter  Models.  The  CSPR  algorithm  identifies  failure 

type  by  examining  the  output  of  the  Chi-Square  test.  The  Chi-Square  test  results  will 
display  specific  characteristics  that  can  specify  the  failure  as  a  step,  ramp,  or  noise  failure. 
In  fact,  the  bias  detected  iii  the  Chi-Square  output  when  a  failure  occurs  will  generally 
match  the  shape  of  the  failure  itself.  Figure  3.3  shows  the  effect  in  the  Chi-Square  test 
that  will  identify  the  three  different  types  of  failures.  While  the  shape  of  the  ramp  and 
noise  failures  correspond  to  the  exact  shape  of  their  failures,  the  Chi-Square  test  will 
tend  to  recover  from  a  step  bias  failure.  Therefore  the  CSPR  filter  will  expect  a  slightly 
negative  slope  on  a  step  bias  failure.  While  a  human  can  merely  look  at  the  output  of  the 
I  “  I 


StepBiu  RimpBiis  benutiaNw* 

Figure  3.3  Shape  Chi-Square  Test  as  a  Result  of  the  Three  Failure  Types 

Chi-Square  test  to  determine  the  failure  type,  quantitative  criteria  need  to  be  established 
to  differentiate  between  the  types  of  failures.  The  criteria  chosen  are  the  slope  and  the 
intercept  of  a  first  order  line  fit  of  the  Chi-Square  test  over  the  period  of  the  failure.  The 
slope  and  intercept  of  the  line  lit  are  distinct  for  the  tluee  types  of  failures.  The  line  fit 
algorithm  litis  been  adopted  from  MATLA.B  [8j.  The  exact  points  interpolated  will  be 
those  that  violate  the  Chi-Square  failure  threshold.  Table  3.3  explains  how  the  slope  and 
intercept  criteria  distinguish  between  the  three  failures. 

The  CSPR  matching  filter  assumes,  like  the  GLR,  that  the  failed  measurement  has 
already  been  identified.  The  CSPR  algorithm  estimates  the  type  of  failure  for  all  time 
after  the  Chi-Square  test  has  exceeded  the  failure  threshold  at  time,  6^.  It  should  be 
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Table  3.3  Slope  aiol  Intercept  Values  for  the  Three  Types  of  Failures 


Type  of  Failure 

Slope 

Intercept 

Additive- 
Step  Bias 

Zero  or 

Slightly  Negative 

Large  and 
Positive 

Additive 
Ramp  Bias 

Positive 

Zero  or 

Slightly  Negat.ive 

Increase  .n 
\'Ieas.  Noise 

Zero  Mean 
over  Time 

Zero  Mean 
over  Time 

noted  that  the  estimate  of  failure  type  will  improve  over  time  as  the  first  order  line  lit  of 
the  Chi-Square  output  better  matches  the  shape  of  the  failure.  The  results  of  the  CSPR 
matching  filter  are  compared  against  the  GLR  raatching  filter  in  Section  4.5. 

3.^.5  Choosing  between  the  NRS  Filters.  This  section  defines  the  exact  algorithm 
that  will  be  used  to  select  the  filter  both  w'her,  a  fa.ilure  has  and  has  not  occurred.  The 
algorithm  uses  the  results  of  the  bank  of  Chi-Square  tests  and  the  relative  quality  of  the 
satellite  set’s  geometries  to  determine  wliich  filter  is  yielding  accurate  results.  The  criteria 
implemented  to  rate  satellite  geometry  is  the  Position  Dilution  of  Precision(PDOP).  First 
the  no  failu'.e  selection  algorithm  is  discussed,  followed  by  an  explanation  of  what  happens 
when  a  failure  occurs. 

For  all  the  Chi-Squa.ie  tests,  a  threshold  value  has  been  established.  As  long  as 
all  the  filters  are  below  the  threshold,  no  failure  has  been  declared,  and  the  MNRS  is 
opei'uling  in  the  no  failure  condition.  When  no  failure  has  occurred,  the  NRS  filter  1  is 
used  for  navigation,  because  the  filter  ’nas  the  best  possible  combination  of  satellites  and 
transponders  for  navigation  (assuming  that  only  four  satellites  arid  five  transponders  can 
be  used  at  a  time).  Th’s  navigation  solution  is  the  best  since  it  uses  the  four  satellites  with 
the  best  PDCP,  and  the  five  primary  transponders.  Ideally  it  vvculd  be  benefici;..,  to  have 
an  eleventh  filter  updating  with  all  the  possible  .satellite  and  tiansponder  measurements. 
Theoi'etically,  this  filter  would  have  the  best  navigation  correction.  The  eleventh  filter  has 
not  been  implemented  in  this  work  due  to  the  computational  load  of  simulating  another 
NRS  filter. 
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A  failure  is  declared  when  the  Chi-Square  test  for  NRS  filter  1  exceeds  its  threshold. 
Ihi.s  means  that  the  best  navigation  solution,  filter  1,  has  been  distorted  with  a  failure.  At 
this  point  only  one  of  the  other  filters  should  have  a  Chi-Square  test  that  has  not  exceeded 
its  threshold.  This  unaffected  filter  is  now  used  to  correct  the  INS  navigation  solution.  The 
time  at  which  the  NR.S  filter  1  declaret,  a  failure  becomes  the  Chi-Square  estimate  of  the 
time  of  failure,  6-^.  It  should  be  rioted  that  this  estimate  has  varying  degrees  of  accuracy 
depending  on  the  type  of  failure  that  has  affected  the  system.  Equation  (3.56)  expresses 
the  relationship  between  the  actual  time  of  failure  and  the  Chi-Square  estimated  time  of 
failure: 

I'f  ailiimi  —  ^chi  ^dclay  (3.56) 

The  unknown  quantity,  tdeiay,  varies  dramatically  depending  on  whether  the  failure  is  a 
step  bias,  ramp  offset,  or  a  noise  increase.  In  fact,  the  delay  in  detecting  the  ramp  offset 
can  seriously  impact  the  results  of  the  matching  filter  algorithms.  Chapter  IV  addresses 
this  issue  of  detection  delay  in  the  MNRS  algorithm.  However  fur  the  puiposes  of  this 
research,  0^  is  considered  the  best  estimate  of  the  time  of  failure. 

Thus  the  estimated  time  of  failure  and  the  identity  of  the  failed  measurement  are 
passed  to  the  matching  filter  algorithm.s.  This  allows  the  matching  filter  algorithms  to 
identify  the  type  of  failure.  Chapter  IV  will  provide  more  insight  into  these  algorithms 
with  the  results  of  the  various  failure  runs. 

3.5  Chapter  Summary 

This  chapter  has  presented  the  details  for  both  the  navigation  filter  and  failure,  mod¬ 
els.  The  basis  for  the  measurement  models  has  been  di.scuosed  to  help  describe  the  intri¬ 
cacies  of  tlie  NRS  design.  The  state  and  dynamics  model  descciptiom:  illustrate  the  high 
degree  of  nonlinearity  and  time-variance  of  the  system.  The  reduced  order  filter  models 
have  also  been  presented.  The  methods  used  to  induce  the  failures  in  the  simulations  have 
been  shown,  along  with  the  models  for  the  matching  filters  designed  to  detect  and  isolate 
these  failures.  Results  and  analysis  of  the-se  simulations  are  presented  in  the  next  chapter. 
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IV.  Results  and  Analysis 


This  chapter  examines  the  results  of  the  MNR.S  FDIR  algorithm.  First  the  chapter 
presents  flight  simulation  data  to  help  define  the  bounds  of  this  thesis  study.  Next,  the 
tuning  of  the  NRS  filter  is  analyzed  with  regard  to  filter  performance  in  a  failure-free 
environment.  Then  the  effects  of  different  failures  are  shown  on  a  single  NRS  filter.  Finally, 
the  results  achieved  vuth  the  MNRS  FDIR  algorithm  are  presented  in  full  detail,  including 
a  conipariscii  of  matching  filter  algorithms. 


4-i  The  Simulation  Specifications 


This  section  presents  the  specifications  of  the  simulation.  The  specifications  are 
defined  as  the  flight  profile  of  the  aircraft,  the  location  of  the  transponders,  and  the  position 
of  the  satellites  during  the  simulation. 


All  the  simulation  run?  in  this  study  use  a  single  flight  profile  generated  by  PROF- 
GEN.  The  flight  profile  has  been  derived  from  a  two-hour  flight  of  a  fighter  aircraft.  Due  to 
the  computational  load  of  running  a  multiple  model  simulation,  only  the  first  4000  seconds 
of  the  7200  second  flight  profile  are  used  in  the  simulation  studies.  Figure  4.1  provides 
a  three  fllmensionaJ  rendition  of  the  flight  profile.  The  exact  flight  path  is  'hown  as  the 
aircraft  climbs  to  altitude  before  proceeding  through  a  high  speed  low  altitude  mission. 

he  time  of  failure  onset  is  also  displayed  in  Figure  4.1.  This  failure  onset  time  of  2000 
i.e-ouds  is  i  he  sajue  for  all  failure  simulation  runs.  This  failure  onset  time  is  arbitraiiiy 


chosci.  at  the  mid-point  of  the  flight  profile. 


The  flight  profile  was  chosen  over  a  region  of  the  CIGTF  RRS  test  range  to  allow 
the  tTanspoiidei's  to  be  imp.’emanted  in  the  integrated  navigation  system.  While  the  test 
range  has  a  multi'ude  of  transponders,  the  number  of  transponders  used  in  this  thesis  has 
been  limited  to  six;  five  ;iced  for  the  measurament  updates  to  any  cue  NRS  filter.  The 
geographic  coordinates  of  the  six  transponders  sights  are  presented  :u  Table  4.1.  Figure  4.2 
shows  hov/  the  locationo  of  the  transpondeis  correspond  to  the  aircraft’s  position  during  the 
flight  profile,  Despite  the  prc-xicLiity  of  the  aircraft  to  the  transponder  rang',  transponder 


Figure  4.1  Flight  Profile  used  for  the  MNRS  Simulations 

geometry  has  little  impact  on  the  quality  of  the  navigation  solution.  Section  4.4  discusses 
which  geometric  considerations  do  impact  the  results  of  the  MNRS  algorithm. 

Along  with  the  transponders,  the  aircraft  also  receives  measurement  updates  from 
GPS  satellites.  Table  4.2  gives  the  latitude  and  longitude  of  the  five  satellites  used  in 
this  simulation  at  both  the  beginning  and  end  of  the  simulation.  Figure  4.3  shows  the 
relative  positions  of  the  satellites  during  the  simulation.  In  Figure  4.3,  the  orbit  path  of 
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Name 

Latitude  1  Longitude 

Altitude 

n 

mmmmm 

33.01M6' 

glIgdB!aBT»M 

1322.5272/it 

P 

TDC,  NM 

1241.7552/t 

M 

33.44'^58' 

-106.22”  14' 

2417.5144/t 

D 

33.17'’55' 

-106.3P44' 

2695,11/t 

B 

Sac  Peak,  NM 

32.47n6' 

-105.49"  15' 

2804.81/t 

B 

Twin  Buttes,  NM 

32.42”  12' 

-106.07”38' 

1365.71/( 

Table  4.1  Location  of  che  Transponders  Transmitters  in  the  MNRS  Simulation 
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Figure  4.2  Location  of  the  Transponder  Transmitters  with  Respect  to  the  Flight  Profile 


Satellite 

Initial  Latitude 

Initial  Longitude 

Final  Latitude  |  Final  Longitude 

1 

67.90^' 

-172,21° 

58.63° 

42.30° 

2 

34.75“ 

-7?  16° 

38.29“ 

-42.78° 

3 

-43,03° 

-129.49° 

18.18° 

-122.89° 

4 

78.43° 

-49.15° 

-14.42° 

-56.58° 

5 

33.82° 

-150,69° 

40,09° 

176.34° 

Table  4.2  Location  of  the  GPS  Satellites  during  the  MNRS  Simulation 


the  satellites  is  traced  up  to  the  final  position  of  the  satellites  at  time  T  4000  seconds. 
The  dashed  lines  in  Figure  4.3  represent  the  range  vector  at  time  T  ~  4000  seconds  between 
the  five  satellites  and  the  aircaft.  Despite  the  movement  of  the  satellites,  all  five  satellites 
are  in  view  throughout  the  flight  profile  of  the  aircraft.  The  five  satellites  have  been  chosen 
to  prevent  satellite  switching  during  the  simulation  runs. 

The  purpose  of  this  section  has  been  to  provide  credibility  for  the  simulation  results. 
A  worthwhile  computer  simulation  must  demonstrate  parallels  to  the  real  world.  The 
real  world  pc'rallels  for  this  thesis  are  the  real  world  GPS  satellite  positions,  the  RRS 
(.ransponder  positions,  and  the  flight  profile.  While  the  navigation  information  provided 
to  the  NRS  is  simulated,  it  is  a  reasonable  model  for  real  world  navigation  data.  The 
next  section  presents  the  filter  tuning  results  of  a  single  NRS  filter  witMn  the  simulated 
environment. 
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Figure  4,3  Satellites  Orbit  Profiles  with  Respect  to  the  Flight  Profile 


Performance  of  the  NRS  Filter 


This  section  documents  the  performance  of  the  NRS  filters  in  a  failure  free  environ¬ 
ment.  This  section  presents  results  from  NRS  niter  i  simulations.  This  section  begins  with 
an  overview  of  the  changes  made  to  the  NRS  filter  during  this  thesis  research.  Next,  cri¬ 
terion  is  established  lo  evaluate  the  accuracy  of  the  NRS  filter  tuning.  Once  criterion  has 
been  established,  the  results  of  the  NRS  filter  tuning  are  compared  with  past  AFIT  results 
and  specifications  provided  by  CIGTF.  Finally,  the  EKF  tuning  process  is  addressed  with 
an  analysis  of  two  trade-off  decisions  made  in  the  tuning  of  the  NRS  filter. 


The  research  for  this  thesis  began  in  earnest  with  the  blending  of  the  work  done  by 
the  Avionics  Directorate[3]  and  past  AFIT  re5earch[19]  into  a  new  NRS  computer  model. 
While  this  process  required  a  great  deal  of  time  and  effort,  only  two  theoretical  changes 
were  made  to  the  NIIS  algorithm.  I'he  first  change  is  within  the  truth  model  of  the  INS. 
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Previously,  little  information  was  known  about  the  baronietric  altimeter  error  states.  The 
model  originates  from  the  Litton  documentation  [4].  However  research  by  the  Avionics  Di¬ 
rectorate  uncovered  inconsistencies  and  problems  within  the  Litton  documentation.  These 
errors  were  corrected  by  the  Avionics  Directorate  with  the  help  of  Litton  [3].  While  the 
corrections  do  not  dramatically  alter  the  results  of  the  research,  the  changes  do  improve 
the  accuracy  of  the  NRS  truth  model.  The  second  problem  "incovered  in  the  NR.S  model 
existed  in  the  GPS  truth  model  states.  Past  AFIT  work  failed  to  include  dynamics  driving 
noise  to  the  following  GPS  truth  model  error  states;  tropospheric  delay,  ionospheric  delay, 
and  code  loop  range  errors.  This  oversight  allowed  past  NRS  filters  to  demonstrate  un¬ 
usually  good  performance.  By  correcting  the  GPS  and  barometric  altimeter  error  states, 
the  truth  model  becomes  a  more  credible  bridge  between  computer  simulation  and  the  real 
world.  Without  a  highly  accurat.e  truth  model,  algorithms  developed  in  computer  simula¬ 
tion  have  little  credibility  in  the  real  world.  Due  to  the  quality  of  support  provided  by  the 
Avionics  Directorate  and  past  AFIT  research,  the  remaining  model  development  problems 
were  easily  overcome,  and  the  NRS  tuning  proc'^s.s  was  able  to  proceed  on  schedule. 

To  ensure  accurate  navigation  performance,  two  tuning  criteria  are  used  to  evaluate 
the  filter’s  state  variable  performance.  The  first  criterion  is  the  ability  of  the  fifteen  filter 
state  variables  to  track  the  corresponding  fifteen  truth  state  variable.s  adequately.  Opti¬ 
mally,  the  Monte  Carlo  average  of  the  difference  between  the  filter  and  tiuth  state  variables 
should  be  zero  mean  over  the  entire  profile.  The  second  tuning  criterion  is  the  accuracy  of 
the  filter’s  standard  deviation  estimate.  The  filter-predicted  zero  i  the  standard  deviation 
of  each  state,  0  ±  rr^ ,  should  match  the  Monte  Carlo  computed  stamdard  deviation  of  the 
difference  betw'een  filter  and  truth  states,  Cm  c.  Both  tuning  criteria  can  be  plotted 

on  a  single  graph.  Appendix  C  provides  the  mathematical  description  of  all  the  variables 
used  in  each  of  the  filter  tuning  plots. 

Before  tlie  filter  tuning  plots  are  presented,  a  variable  transformation  used  in  this 
thesis  must  be  defined.  While  the  first  nine  filter  states  are  stored  and  propagated  in  a 
com}iuted  true  reference  trame,  this  frame  of  reference  does  not  provide  a  great  deal  of 
physical  insight.  Therefore  results  of  the  filter  tuning  are  transformed  to  the  East-North- 
Up  (ENU)  fraine;  hence,  position  errors  are  presented  in  latitude,  longitude,  and  altitude 


error.  TVie  velocity  and  tilt  errors  are  similarly  documented  in  the  East- North-Up  frame. 
The  transformation  used  to  present  the  material  in  the  ENU  frame  is  orthogonal  and  has 
been  documented  in  past  AFIT  research  [14,  19]. 


Time  (sec) 


Figure  4.4  Longitude  Filter  Error  Tuning  Plot 
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plot  is  analyzed  in  f'igure  4.4.  This  figure  allows  the  two  tuning  criteria  to  be  evaluated 
at  the  same  time.  Within  Figure  4.4,  the  Monte  Carlo  calculated  mean  value  of  the 
difl'erence  between  the  filter  and  truth  models  longitude  error  is  display3d  by  the  solid  line 
tracking  the  x-axis.  The  filter’s  ability  to  track  the  longitude  error  of  the  truth  model 
is  demonstrated  by  the  zero  mean  nature  of  this  trace.  The  second  tuning  criterion  is 
evaluated  by  examining  the  two  pair  of  symmetric  traces  in  Figure  4.4.  The  pair  of  dotted 
lines  is  the  Monte  Carlo  calculated  meand:  standard  deviation  of  the  difference  between 


the  fdter  and  tiuth  model  longitude  error.  The  dashed  lines  represent  zero  ±  the  filier- 
predicted  standard  deviation  of  the  erfo>-.  Optimal  filter  tuning  would  have  these  two  pair 
of  lines  overlapping  over  time.  The  pair  of  lines  in  Figure  4.4  are  close  to  overlapping  with 


the  filter-predicted  standard  deviation  greater  then  the  Monte  Carlo  calculated  (i.e.,  the 
filter  is  less  confidence  in  itself  than  it  could  be).  The  conservative  nature  of  this  tuning 
proved  to  be  necessary  to  maintain  good  tracking  of  the  most  important  navigation  states. 
Filter  tuning  plots  for  all  the  filter  states  are  located  in  Appendix  C. 


Table  4.3  Temporal  Averages  of  True  Filter  Errors  (Icr) 


Filter 


North 

Up 

East 

North 

Azi¬ 

Vel 

Vel 

Tilt 

Tilt 

muth 

(fps) 

(fps) 

(arcs) 

(arcs) 

(arcs) 

13.00  I  13.00  I  40.00  II  0.100  |  0.100  |  0.400  ||  n/a 


l■ai■ 


EJ 


NRS  1992  4.00 


NRS  1993 


7.22  8.63 


6.64  15.96 


0.032  0.029  0.070  3.13  1  4.49  |  17.57 


0.062  0.062  .137  4.05  4.41  27.94 


Despite  the  best  possible  filter  tuning,  the  actual  quality  of  the  filter  performance  is 
also  limited  by  the  size  and  the  structure  of  the  model  itself.  Therefore  good  filter  tuning 
cannot  be  the  final  criterion  used  to  evaluate  a  filter.  The  quality  of  a  navigation  filter  is 
best  described  by  the  errors  made  in  the  estimation  of  position,  velocity,  and  orientation. 
Table  4.3  contains  the  temporal  averages  for  these  errors  over  the  complete  flight  profile. 
The  table  provides  two  references  for  comparison;  the  original  CIGTF  specifications  for  the 
system  and  the  results  attained  from  a  fifteen-stale  NRS  filter  implemented  in  past  AFIT 
research  [19].  While  the  performance  of  the  filter  easily  meets  the  CIGTF  specifications,  the 
results  are  slightly  degraded  with  respect  to  past  AFIT  research.  The  slight  degradation  in 
perfoniiancu  of  some  states  is  attributed  to  two  factors.  First,  the  model  last  year  did  not 
employ  dyna^rdcs  driving  noise  on  all  the  GPS  truth  states.  Second,  the  new  NRS  model 
uses  only  fi.e  transponder  sigr.-dr  for  m.easuremeat  updates  while  past  AFIT  research  used 
six.  Therefore,  given  the  results  of  th*.  NRS  tuning  process,  the  filter  achieved  is  adequate 
for  the  purposes  of  simulating  tl  Ml'  •  S  FDiR  algorithm. 

To  understand  the  m  echanics  o!  '  *>  ■  juing  better,  background  is  provided  on  two 
specific  tuning  decisto.os.  The  fiist  tui  '  cision  is  the  choice  of  tuning  criterion.  If 
residual  performance  is  more  important  l  :  c  .  ate  variable  performance,  the  residuals  can 
be  used  instead  of  state  variables  to  evalu  ’■  ’  ter  tuning.  In  this  case,  the  filter-predicted 
(zero-)mean±sigma  of  the  residuals  is  co.  -.s.ed  to  the  actual  Monte  Carlo  calculated 
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meaaisigma  of  the  residuals.  The  standards  for  good  performance  arc  the  same  as  for  the 
state  variable  tuning.  An  example  of  a  residual  plot  for  NRS  filter  1  is  given  in  Figure  4.5. 
This  figure  clearly  shows  that  the  residuals  are  zero-mean  and  appear  uncorrelated  over 
time,  yet  highly  conservative  with  regard  to  its  estimate  of  residual  standard  deviation. 
While  the  conservative  nature  of  the  residuals  impedes  FDIR,  the  importance  of  state 
variable  performance  is  deemed  to  outweigh  FDIR  concerns.  Degradation  of  the  naviga¬ 
tion  quality  for  the  sake  of  FDIR  performance  is  not  acceptable.  Therefore,  due  to  this 
constraint,  a  trade-off  has  been  made  in  favor  of  state  variable  estimation  over  residual 
performance. 
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Figure  4.5  Example  of  Scalar  Residual  Tuning  of  the  NRS  Model 


The  second  tuning  decision  that  is  addressed,  regards  the  relative  quality  of  tuning 
between  individual  state  variables.  Quite  often  tuning  quality  on  one  state  must  be  sacri¬ 
ficed  to  achieve  the  desired  performance  of  a  more  important  state.  Figure  4.6  shows  the 
two  coupled  GPS  states  in  the  filter,  GPS  user  clock  bias  and  drift.  The  user  clock  bias 
shows  excellent  performance  under  both  tuning  criteria,  while  the  drift  appears  to  be  tuned 
far  too  conservatively.  These  two  states  ire  coupled,  so  changes  to  the  user  GPS  clock  drift 
also  affect  the  user  clock  bias  state.  Attempts  to  improve  the  confidence  of  the  drift  state 
seriously  degraded  the  tracking  of  the  user  clock  bias  state.  Since  the  accuracy  of  the  user 
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Figure  4.6  Relative  Tuning  of  the  GPS  User  Clock  Bias  and  Drift  States 


clock  bias  state  is  more  important,  the  drift  state  has  been  left  with  its  conservative  tuning. 
While  this  tuning  is  acceptable  for  the  needs  of  this  work,  had  GPS  drift  been  more  cucial 
to  the  operation  of  the  overall  system,  the  tuning  would  need  to  be  reevaluated. 


By  describing  a  few  of  the  tuning  decisions  made  in  this  thesis,  hopefully  the  subjec¬ 
tive  nature  of  filter  tuning  has  been  established.  Good  filter  tuning  can  change  depending 
on  the  situation  and  the  stipulations  placed  upon  the  designer.  The  NRS  filter  has  been 
tuned  to  attain  the  best  estimates  for  position,  velocity,  and  attitude  error.  If  the  filter  is 


applied  to  other  new  applications  in  the  future,  the  tuning  criteria,  and  results  shoidd  be 
rGcon.sid.6rsd,  Tliis  concludss  tb.6  discussicn  on  filtor  tKs  n^xt  section  prsEcnts  the 


results  from  the  MNRS  FDIR  simulation  runs. 


4.3  Performance  of  the  MNRS  Filter 

The  MNRS  simulation  runs  provide  definitive  results  in  favor  of  multiple  model  FDIR 
algorithms.  The  presentation  of  the  MNRS  results  is  divided  into  three  sections.  First  the 
effect  of  the  failures  on  a  single  NRS  filter  is  shown.  These  results  are  included  to  niotivate 
the  need  for  a  recoverable  failure  analysis  algorithm.  Once  the  need  of  for  the  MNRS  has 
been  established,  the  results  from  the  MNRS  simulation  runs  are  presented.  Finally  the 
impact  of  satellite  geometry  on  individual  NRS  filters  is  analyzed  in  the  last  section. 
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Figure  4.7  Comparison  of  the  Effect  of  Satellite  Failures  on  the  Longitude  Error  State 
Tracking  of  NRS  Filter  1 


4,3.1  Impact  of  the  Failures  on  the  NRS  Navigation  Solution.  To  justify  the  need 
for  an  FDIR  algorithm,  the  effect  of  the  failures  on  the  NRS  filter  are  shown.  To  analyze 
the  effect,  a  .single  run  of  the  filter-estimated  longitude  error  is  compared  to  the  failure-free 
truth  longitude  error.  When  the  filter  is  operating  in  a  failure-free  environment,  the  filter 
longitude  error  can  track  the  truth  model  error,  as  seen  in  Figure  4. 7. a.  Each  of  the  three 
types  of  failures  added  to  the  truth  model  range  measurements,  bias  the  filter  model  such 
that  it  can  no  longer  track  the  truth  model  state  variables.  Figures  4.7.b,  4.7.c,  and  4.7.d 
show'  that  the  filter  solution  for  longitude  error  deviates  from  the  truth  model.  These 
plots  have  been  included  to  motivate  the  need  for  a  recoverable  system.  The  knowledge  of 
the  existence  of  a  failure  alone  does  not  aid  the  user  in  his  navigation.  Without  recovery, 
all  that  can  be  done  is  to  turn  off  the  filter  corrections  to  the  INS.  Yet  with  the  MNRS 
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recoverable  filter  algorithm,  the  INS  receives  accurate  navigaiion  corrections  throughout 
the  duration  of  the  failure. 

^.3.2  Itci^ulls  of  the  MNRS  FDIR  Algorithm.  The  MNRS  FDIR  algorithm  results 
are  disoissed  in  this  section.  Seven  failure  runs  are  documented:  six  failure  runs  and  a 
baseline  run  for  comparison.  For  each  of  these  seven  runs,  all  ten  NRS  filters  have  been 
simulated  runrung  in  parallel  over  the  4000-second  flight  profile.  Each  of  the  NRS  filters  is 
updated  with  identical  measurement  signals  every  two  seconds  over  a  15-run  Monte  Carlo 
simulation.  While  past  AFIT  research  implemented  only  10-run  Monte  Carlo  analysis, 
the  increased  computing  capacity  of  AFIT  has  allowed  15-run  Monte  Carlo  analysis  to  be 
implemented.  This  increase  in  the  number  of  simulation  runs  improves  the  validity  of  the 
Monte  Carlo  calculated  mean  and  standard  deviation  of  the  state  variables  and  residuals. 
The  analysis  of  the  simulations  not  only  focuses  on  the  effectiveness  of  the  MNRS  as  an 
FDIR  algorithm,  but  also  on  the  different  failure  runs  with  regard  to  residual  performance. 

The  majority  of  the  MNRS  results  are  contained  in  the  Appendices  D-J.  Appen¬ 
dices  D,  E,  and  H  contain  Monte  Carlo  scalar  residual  data  for  each  measurement  update 
of  each  NRS  filter  in  each  failure  run.  Appendices  F,  G,  1,  and  J  contain  Monte  Carlo 
scalar  residual  data  for  only  one  measurement  update  of  each  NRS  filter  i  iach  failure 
run.  The  one  residual  plot  included  is  for  the  failed  measurement,  single  residual 

plots  have  been  included  to  allow  the  reader  to  see  the  actual  upact  oi  th  j  failure  on  the 
performance  of  the  niter.  Appendix  K  contains  the  Chi-Square  lest  r  'ts  of  each  NRS 
filter  in  each  failure  run.  Appendix  K  also  includes  a  chart  for  eac,  an,  displaying 

which  filter  is  actively  providing  the  navigation  correction  at  each  poi  n  time.  The  raw 
data  collected  in  this  thesis  has  been  included  in  these  appendices,  not  to  overwhelm  the 
reader,  but  to  allow  a  chance  to  evaluate  the  conclusions  reached  by  tin  author.  Without 
access  to  the  raw  simulation  data,  analysis  of  the  analyst  can  be  difficult. 

4. 3. 2.1  Baseline,  No  Failnre.  To  provide  a  comparison  with  the  failure 
runs,  one  complete  MNRS  run  is  conducted  with  no  failures  induced  in  the  truth  model. 
Individual  scalar  residual  and  the  Chi-Square  test  results  are  analyzed  to  verify  the  oper¬ 
ation  of  the  ten  NRS  filters  and  to  assist  in  the  choice  of  a  failure  detection  threshold. 
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A  IS-uin  Monte  Carlo  simulation  doinonstratos  the  good  residual  performance  of  all 
tiic  NRS  filters.  As  can  be  seen  in  Appendix  D,  the  Monte  Carlo  calculated  scalar  resid- 
uahs  are  zero-mean  over  time.  Looking  specifically  at  NRS  filter  I  (Figures  D.l  and  D.2), 
the  scalar  residuals  reflect  conservative  tuning  with  regard  to  measurement  confidence. 
This  conservative  tuning  with  regard  to  the  residual  covariance,  [H ft],  removes 
high,  frequency  effects  of  the  scalar  measurement  updates:  both  unwanted  noise  and  mea¬ 
surement  information.  The  navigation  information  lost  due  to  the  conservative  tuning 
is  partially  recovered  by  the  high  sampling  rate  of  the  measurements.  The  two-second 
sampling  rate  used  for  all  the  measurement  updates  is  equal  to  or  faster  than  any  imple¬ 
mented  in  past  AFrr  research  [14,  19].  Therefore  the  effect  of  the  reduced  confidence  in 
the  ine.asurement  updates  is  offset  by  the  high  sampling  rate. 

•su 

50 

^  w 

I 

I™ 

^  20 

Jf 

<f 

500  1000  ISQO  3000  2500  3000  3500  4000 

NKSRJtcr#! 

Figure  4.8  Baseline  Chi-Square  Test  Resirlts  with  the  Chosen  Failure  Thresholds  15 


The  baseline  simulation  also  provides  the  necessary  data  to  select  the  threshold  for 
the  Chi-Square  test.  Threshold  selection,  as  discussed  in  Section  2,3.4,  is  dependent  on  the 
failure-free  respotrse  of  the  residuals  to  normal  system  dynamics.  The  threshold  must  be 
chosen  to  maintain  a  low  false  alarm  rate  in  a  failure-free  environment.  Figure  4.8  shows 
ihc  results  of  the  Chi  Square  test  conducted  on  NRS  filter  1 .  The  threshold  has  been  cho¬ 
sen  greater  than  the  maximum  value  of  the  Chi-Square  test.  This  conservative  choice  of 
threshold  eliminates  the  possibility  of  a  false  alarm  for  the  purposes  of  this  simulation.  This 
simulation  has  been  limited  to  the  flight  of  one  flight  profile  under  15  distinct  represen- 


tations  of  dynamics  and  measurement  truth  model  noise.  More  comprehensive  simulation 
testing  and  hardware  testing  would  be  subsequent  steps  to  iterate  the  magnitude  of  the 
threshold  for  the  Chi-Square  test  further. 

Since  no  failure  has  been  introduced  to  the  sys<^era  for  this  failure  run,  none  of 
the  NRS  filters  violate  the  threshold  test  during  the  simulation,  a,s  seen  in  Figures  K.l 
and  K.2.  Therefore,  by  the  criteria  established  in  Section  3.4.5,  the  NRS  filter  1  will 
continue  to  provide  the  error  state  corrections  to  the  INS  navigation  solution.  Figure  K.3 
graphically  displays  which  of  the  NRS  filters  provides  the  navigation  correction  to  the  INS 
throughout  the  simulation.  With  the  baseline  residual  performance  verified  and  the  Chi- 
Square  threshold  established  in  a  failure-free  simulation  run,  the  response  of  the  MNRS 
algorithm  to  the  six  failures  is  presented  next. 

4. 3. 2. 2  Transponder  Bias  Failure.  The  transponder  step  bias  failure  run 
differs  from  the  baseline  run  in  that  a  base  of  800ft  is  added  to  the  Transponder  1  range 
signal  between  2000-3000  seconds  in  the  simulation.  During  the  simulation,  the  Chi- 
Square  test  exceeds  its  threshold  in  each  filter  that  receives  the  failed  measurement  signal. 
Figures  K.4  and  K.5  shew  that  only  NRS  filter  10  does  not  exceed  the  threshold.  Therefore, 
the  MNRS  filter  switches  from  NRS  filter  1  to  10  for  the  duration  of  the  threshold  test 
violation  on  NRS  filter  1  (see  Figure  K.OJ.  Appendix  E  contains  the  individual  scalar 
residual  plots  for  each  filter  for  this  simulation  to  support  these  results. 

While  the  MNRS  FDIR  technique  adequately  performs  during  the  failure  run,  the 
residual  response  to  the  failures  is  somewhat  unexpected.  Past  research  of  EKF  FDI 
techniques  has  shown  that  the  residuals  of  a  EKF  tend  to  recover  from  a  step  failure  over 
time  [2,  5].  The  recovery  from  the  failure  is  caused  by  the  consistent  nature  of  the  step 
failure.  Slowly  the  filter  will  compensate  for  the  existence  of  the  step  bias,  and  the  residuals 
will  return  to  zero  mean.  When  this  occurs,  the  Chi-Square  test  will  no  longer  signal  a 
failure,  and  an  observer  might  conclude  that  the  bias  is  no  longer  affecting  the  system. 
This  type  of  residual  behavior  does  not  allow  for  prolonged  detection  of  additive  constant 
biases  failures  in  the  measurement  signals. 
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Figu.e  4.9  For  NRS  Filter  1,  the  Transponder  1  Measurenient  Residual  Response  to  a 
Transponder  .Step  Bias^SOOft 


In  contrast  to  the  expected  residual  response  to  a  step  bias,  the  scalar  residual  of  the 
Transponder  1  measurement  does  not  recover  from  the  failure  over  time.  As  can  be  seen 
in  Figure  4.9,  the  residual  bias  is  constant  during  the  failure  time.  The  lack  of  recovery 
is  caused  by  the  modelling  of  the  transponder  error  states  in  the  NRS  filter.  Since  both 
transponder  state  variables  ctre  modelled  as  random  biases  with  relatively  small  levels  of 
dynamics  driving  noise,  the  filter  has  no  state  variables  that  can  easily  absorb  the  failure 
offsets.  The  magnitude  of  the  tuning  noise  covariance  would  need  to  be  dramatically 
increased  to  absorb  unmodelled  biases.  However  increasing  this  tuning  noise  would  greatly 
reduce  the  filter’s  state  variable  performance.  Therefore  it  is  the  choice  of  filter  model  and 
the  relative  tuning  strengths  that  causes  the  filter  to  maintain  detection  over  the  entire 
lifetime  of  the  failure. 


4-3. 2. 3  Transponder  Ramp  Failure.  As  with  the  transponder  step  bias,  the 
ramp  failure  of  transponder  signal  is  easily  detected  by  the  MNR.S  FDIR  algorithm.  As 
seen  in  Figures  K.7  and  K.8,  each  filter  receiving  the  failed  measurement  rapidly  exceeds 
the  threshold  of  the  Chi-, Square  test.  Figure  K.9  shows  the  effective  switching  of  filters  for 
the  duration  of  the  threshold  violation.  For  the  transponder  ramp  failure,  tiie  threshold 
violation  directly  corresponds  to  the  duration  of  the  measurement  failure.  Therefore  the 
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MNRS  FDIR  algorithm  both  delects  and  recovers  from  the  transponder  ramp  failures. 
Appendix  F  contains  the  transponder  1  scalar  residual  plots  for  all  ten  NRS  filters. 
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Figure  4.10  The  Effect  of  a  Transponder  Ramp  Failure  on  the  Residuals  of  oiher  Satellite 
and  Transponder  Measurements 

One  important  aspect  of  any  EKF  is  the  state  feedback  into  the  F  and  H  matrices  of 
the  linearized  state  and  measurement  equations.  After  each  measurement  update,  the  EKF 
will  reevaluate  the  components  of  the  F  and  H  matrices  based  upon  the  new  state  estimate, 
and  newly  declared  trajectory  segments  emanating  from  that  new  estimate.  This 
allows  a  failure  added  in  one  measurement  to  be  reflected  in  the  residuals  of  the  other 
measurements.  Figure  4.10  compares  the  residuals  of  a  satellite  and  transponder  when  a 
second  transponder  signal  has  been  failed.  While  t.he  Satellite  1  measurement  residual  is 
biased  by  the  Transponder  1  failure,  the  effect  on  the  Transponder  2  measurement  residual 
is  more  severe.  Therefore,  it  is  easier  for  a  failed  transponder  measurement  to  affect  other 
transponders  rather  than  satellites.  The  translation  of  the  failure  into  all  the  residuals 
increases  the  fidelity  of  the  Chi-Square  test  and  allows  for  consistent  failure  detection. 

4- 3. 2. 4  Transponder  Noise  Failure.  Like  the  two  other  transponder  fail¬ 
ures,  an  increase  in  the  transponder  measurement  noise  is  detected  by  the  MNRS  filter. 
Figures  K.IO,  K.ll,  and  K.i2  show  how  the  MNRS  detects  the  failure  in  nine  of  the  ten 
filters  and  switches  to  the  tenth  filter  for  navigation.  The  window  size,  =  3,  of  the 
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Chi-Square  test  keeps  the  Chi-Square  value  above  the  threshold  despite  the  occasional 
low  value  of  failed  measurement  noise  si,mples.  Therefore,  due  to  the  size  of  the  failure 
induced  and  the  low-pass  filtering  elfect  of  the  Chi-Square  window  size,  the  MNRS  FDIR 
algorithm  recognizes  and  compensates  for  the  noise  failure  over  the  entire  period  of  the 
failure.  Appendix  G  contains  the  number  1  transponder  scalar  residual  plots  for  all  ten 
NRS  filters. 
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^’igure  4.11  Coraparisou  of  Step,  Ramp,  and  Noise  Transponder  Biases  on  the  Scalar 
Residued  of  'i ransponder  Measurement  1  of  NRS  filter  1 

As  with  the  previous  two  transponder  measurement  failures,  the  transponder  noise 
failure  generates  a  unique  response  in  the  scalar  re;  iduol  measurements.  The  failure  type 
can  be  visually  identified  in  the  scalar  residual  of  the  failed  measurement.  Figure  4.11 


compares  Um  residuals  of  the  Transponder  1  measureuient  for  the  l.raiis])oiulor  step,  ramp, 
and  noise  failures.  As  can  be  seen,  each  of  the  failures  causes  a  unique  reaction  in  the 
scalar  lucasurement  residual.  During  the  step  bias,  the  Monte  Carlo  mean  of  the  residual 
rises  to  a  peak  and  then  maintains  a  constant  value  through  the  failure  period.  During  the 
ramp  offset,  the  residual  mean  slowly  slopes  away  froir  'ero  mean.  Finally,  the  increase  in 
the  measurement  noise  increases  the  standard  deviation  of  the  residual  without  changing 
its  mean  value.  The  two  matching  filter  techniques  described  in  Sections  2.3.2  and  2.3.3 
will  attempt  to  exploit  this  behavior  in  the  residuals  to  identify  the  type  of  failure  affecting 
the  system. 


4-3. 2.5  Satellite  Bias  Failure,  Whi-e  the  MNRS  FDIR  algorithm  correctly 
identifies  and  recovers  from  a  satellite  step  bias  failure,  the  residual  results  differ  in  signif¬ 
icant  ways  from  the  transponder  step  bias  results  of  Section  4  3.2.2.  Before  the  differences 
are  discussed,  the  Chi-Square  test  results  for  the  satellite  step  bia.s  failure  run  are  presented. 


Figures  K.13  ami  K.14  show  the  results  for  the  individual  Chi-Siiuare  tests  conducted  on 


each  filter.  As  can  be  seen  in  the  Chi-Square  plots,  NRS  filter  3  is  the  only  filter  not 
receiving  the  failed  measurement  signal.  Therefore,  as  seen  in  Figure  K.15,  t.he  navig-ation 
correction  switches  to  NRS  filter  3  for  the  duration  of  the  Chi-Square  threshold  violation. 
Therefore  the  MNRS  FDIR  algorithm  does  isolate,  detect,  and  recover  from  a  satellite  step 
bias  failure.  Appendix  H  contains  all  transponder  and  satellite  scalar  residual  plots  for  the 
ten  NRS  filters. 


Despite  the  fact  that  tlie  MNRS  filter  detects  and  recovers  from  both  satellite  and 
transponder  step  bias  failures,  the  effect  of  the  two  failures  on  the  scalar  residuals  differs 
drastically.  As  previously  discussed  in  Section  4.3. 2.3,  the  transponder  step  bias  causes  a 
continuous  bias  in  the  residual  of  the  measurement  residuals.  This  constant  bias  allows  the 
Chi-Square  test  to  detect  the  failure  accurately  over  the  entire  failure  lifetime.  While  this  is 
true  for  a  transponder  failure,  it  is  not  true  for  a  satellite  failure.  During  the  satellite  step 
bias  simulation,  the  magnitude  of  the  Chi-Square  test  initially  spikes  when  the  failure  first 
occurs.  After  the  initial  spike,  the  magnitude  of  the  Chi-Square  variable  decreases  back 
down  to  a  failure-free  level.  Figure  4.12  shows  how  the  filter  actually  ’Tearns“  the  failure 
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and  incorporates  the  erroneous  data  until  it  is  impossible  to  distinguish  that  the  failure 
is  still  occurring.  This  result  is  expected,  since  the  GPS  filter  model  contains  error  states 
that  absorb  the  effect  of  the  failure.  The  EKF  interprets  the  satellite  step  bias  failure  as 
a  change  in  the  GPS  user  clock  drift  and  bias  error  states.  The  filter  uses  these  states  to 
account  for  the  failure  elfeci,  thereby  removing  the  bias  from  the  measurement  residuals. 


NRSKlta#!  NRSFUlaffl 

Satellite  Step  Bias  Transponder  Step  Bias 

Figure  4.12  Effect  of  a  Satellite  Bias  as  Compared  to  a  Transponder  Bias  on  the  Chi- 
Square  Test  of  NRS  Filter  1 

While  this  effect  is  expected,  it  is  not  desirable.  Had  the  failure  duration  been 
extended  to  2000  seconds,  the  Chi-Square  test  would  no  longer  have  been  a  valid  decision¬ 
maker  between  the  different  NRS  filters.  One  by  one  each  Chi-Square  test  would  fall  below 
threshold,  despite  the  fact  that  the  failure  still  existed.  While  this  effect  impairs  the  per- 
form^nce  of  the  MNRS  algorithm,  a  proposal  is  considered  in  Section  4.5  to  use  the  results 
of  a  matching  filter  to  compensate  for  the  step  bias  failure.  Given  the  implementation 
NRS  filters  used  in  this  thesis,  the  MNRS  algorithm  cannot  counteract  the  learning  oi  the 
satellite  step  bias  failure. 

4.3. 2. 6  Satellite  Ramp  Failure.  The  results  from  the  satellite  ramp  bias 
failure  run  are  similar  to  the  step  offset  results.  Wliile  the  MNRS  FDIR  algorithm  is  able 
to  identify  and  recover  from  the  failure  correctly,  the  filter  itself  impedes  the  performance 
of  the  algorithm,  compared  to  the  transponder  ramp  bias  results.  The  results  achieved 
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Figure  4.13  Comparison  of  Satellite  and  Transponder  Residuals,  Each  Affected  with  a 
Additive  Ramp  Bias 


by  simulating  the  ten  filters  running  in  parallel  can  be  seen  in  the  Chi-Square  plots  in 
Figures  K.16  and  K,17.  In  these  figures,  each  individual  Chi-Square  test  experiences 
significant  delay  in  detecting  the  failure.  Figure  4.13  compares  the  scalar  residuals  of 
a  satellite  and  transponder  measurement,  each  biased  with  a  ramp  failure.  While  the 
transponder  residual  immediately  slopes  away  from  zero  mean  at  a  high  rate,  the  satellite 
residual  barely  exceeds  the  filter-predicted  standard  deviation.  Although  the  reader  might 
suspect  that  this  effect  is  caused  by  the  relative  precision  of  the  two  types  of  measurement 
updates,  the  relatively  equal  weighting  of  the  tuning  gains  for  satellite  and  transponder 
measurements  does  not  support  such  a  conclusion  (see  Table  B.9).  This  subdued  failure 
effect  is  directly  related  to  the  GPS  user  clock  drift  and  bias  states  and  their  tendency  to 
compensate  lor  satellite  failures.  Despite  the  reduced  response  due  to  state  compensation 
to  failures,  the  MNRS  can  still  detect  and  compensate  for  failures,  thereby  maintaining 
robust  navigation  (see  Figure  K,18).  Appendix  I  contains  satellite  3  scalar  residual  plots 
for  the  ten  NRS  filters. 


4-3. 2. 7  Satellite  Noise  Failure.  The  final  failure  run  in  the  thesis  simulates 
an  increase  in  measurement  noise  on  a  satellite  measurement.  While  each  of  the  NRS 
filters  is  able  to  maintain  residual  stability  (zero  mean),  the  increase  in  the  variance  of  the 
measurement  residuals  is  detected  by  the  MNRS  algorithm.  As  can  be  seen  in  Appendix  J, 


the  MoiiLc  Carlo  calculated  variance  of  the  residuals  increases  during  the  time  of  the  failure. 
This  increase  in  the  variance  of  the  residuals  translates  into  large  spikes  in  the  output  of  the 
Chi-Squarc  tests  on  each  of  the  filters  that  receives  the  failed  measurcmcnl.  Figures  K.19 
and  K.20  display  the  Chi-Square  threshold  tests  for  all  ten  filters.  Figure  K.21  shows  the 
navigation  switches  to  NRS  filter  3  for  the  duration  of  the  increase  in  measurement  noise. 

Each  of  the  failure  runs,  the  three  transponder  and  three  satellite  runs  demonstrate 
the  effectiveness  of  the  MNRS  algorithm.  By  liir.itaig  the  distribution  of  measurements  to 
identical  {liters,  failures  are  easily  detected  and  recovered.  There  is  no  need  for  feedback 
since  one  of  the  NRS  filters  newer  updates  with  the  failed  measurenieiit.  Therefore  the 
MNRS  algorithm  is  successful  in  accomplishing  failure  detection,  isolation,  and  recovery 
within  the  scope  of  the  failure  environment  imposed  in  this  research.  This  concludes  the 
analysis  of  the  MNRS  FDIR  algorithm. 

4.i  Analysis  of  Measurement  Geometry 

This  section  analyzes  the  effects  of  satellite  constellation  geometry  on  the  perfor¬ 
mance  of  individual  NRS  hllers.  Measuremem  geometry  is  defi  o'd  as  tlie  positioning  of 
the  ra,nge  measurement  sources  relative  to  the  aircraft.  Measurement  geometry  quite  often 
dictates  the  quality  of  the  navigation  solution  of  an  integrated  navigation  system.  Due  to 
the  multiple  model  structure  of  the  MNRS  algorithm,  the  da>p  collected  in  this  thesis  can 
also  be  used  to  analyze  satellite  geometry.  This  is  possible  riace  each  filter  in  the  MNRS 
iiiodf?!  is  iipd^-t^d  with  3.  unitju^  of  nifcisurciuoiits  T9,bl9  1,1).  In  this  3,n3lysis,  the 
longitude  erroi  of  an  NRS  filter  is  used  to  study  the  effect  of  satellite  geometry  on  the 
performance  of  the  state  variables.  Next  the  effect  of  satellite  geometry  on  the  residuals 
is  also  examined.  This  section  demonstrates  that  satellite  geometry  impacts  both  state 
variable  tracking  and  the  FDIR  performance  of  the  NRS  filter. 

Of  the  two  types  of  range  measurements,  GPS  and  RRS,  GPS  satellite  geometry 
has  a  distinctly  larger  effect  on  the  state  variable  tracking  of  the  NRS  model.  To  explore 
the  impact  of  satellite  geometry,  the  baseline  simulation  runs  of  NRS  filters  1  and  4  are 
compared.  Table  1.1  shows  how  these  two  filters  differ  by  only  one  satellite  measurement. 
The  two  filters  are  otherwise  identical  in  all  regards  in  this  simulation  study.  Figure  4.14 
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Loofinide  error,  fft) 


shows  the  impact  of  the  difi'erent  satellite  geometries  on  the  longitude  error  of  the  two 
iillers.  The  two  plots  in  the  figure  display  the  difl'eronce  between  the  Monte  Carlo  calculated 
mean  ±  1  standard  deviation  of  the  diirerenee  between  the  filter  longitude  error-state 
and  the  triuh  model  longitude  error  in  a  failure-free  environment.  The  figure  shows  that 
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Figure  4.14  Comparison  of  Longitude  Error  States  of  NRS  Filters  with  Different  Satellite 
Geometry 


NRS  filtei  4  does  not  maintain  zero  mean  tracking  of  the  truth  model  longitude  error. 
The  inability  co  Tack  the  error  is  caused  by  the  relatively  poor  PDOP  of  NRS  filter  4 
compared  to  filter  1.  Tne  initial  PDOP  values  for  each  of  the  two  satellite  measurement 
sets  are  recorded  below  tiie  two  plots  in  Figure  4.14.  Since  the  direct  relationship  between 
PDOP  and  v-tate  estimation  iias  been  anticipated,  the  satellite  measurement  set  with  the 
best  geometry  is  chosen  to  update  the  filter  in  the  failure-free  environment. 

While  poor  satellite  geometi  ;'  has  a  negative  effect  on  filter  navigation,  poor  geometry 
actually  makes  failure  detection  easier.  When  a  filter  is  affected  with  an  nnmodelled  failure 
bias,  filters  with  poor  geometry  reflect  this  failure  more  clearly  in  the  residuals.  On  the 
other  hand,  when  the  geometry  is  good,  the  unmodelled  failure  bias  is  partially  absorbed 
into  the  filter  state  estimates.  Figure  4.15  compares  a  scalar  residual  of  NRS  filters  1  and 
4,  each  affected  with  a  satellite  step  failure.  The  filter  with  the  poor  geometry,  filter  4, 
shows  a  larger  failure  bias  in  the  scalar  residua!  than  filter  1.  Therefore,  when  a  wid-Square 
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Figure  4.15  Comparison  of  Transponder  1  Scalar  Measurement  Residuals  for  NRS  Fil¬ 
lers  1  and  4  during  a  Step  Bias  Simulation  Run 

test  is  conducted  on  the  two  filters,  the  magnitude  of  the  test  will  be  greater  in  the  filter 
with  poor  geometry,  f  igure  4.16  compares  the  two  Chi-Square  te.sts  for  filters  1  and  4  for 
the  Satellite  .step  bias  simuiatioa.  As  can  be  seen  in  the  figure,  the  Chi-Square  test  has  an 
easier  time  detecting  the  failure  in  the  filter  with  poor  geometry.  Therefore  it  is  concluded 
that  good  measurement  geometry  hinders  the  ability  of  an  FDIR  algorithm  to  detect  a 
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Figure  4.16  Comparison  of  Chi-Square  Results  for  NRS  Filters  1  and  4  during  a  Step 
Bias  Simulation  Run 
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TIr'  two  conclusions  about  gooinolry  loiiiforco  procoiicoivod  notions  about  the  NUS 
inodol.  First,  good  geoiiRtry  does  improve  the  quality  of  slate  estiuiation,  Since  more 
accurate  stale  peribrmance  is  d('sirablo,  good  geometry  is  also  desirable,  lb  go  along  with 
the  improved  slate  estimation,  good  geometry  also  helps  the  lillcr  to  track  unmodelled 
failure  biases.  This  tracking  makes  failure  detection  more  dilllcult.  While  this  section  has 
addressed  seme  of  the  i.ssues  involving  measuieiuent  geometry  considerations,  the  analysis 
is  far  from  complete.  Possibilities  for  future  research  endeavors  will  be  discussed  in  Chapter 
V. 

4.5  Performance  of  the  Matching  Filter  Algorithms 

The  last  research  undertaken  has  been  the  work  to  develop  an  accurate  matching 
lilter  algorithm  to  add  to  the  MNRS  FDIll.  algorithm.  The  purpose  of  the  matching  fdter 
is  to  identify  the  type  of  measureuRuit  error  on  a  known  failed  ineasureineni.  Within  the 
scope  of  this  thesis,  it  is  desirable  to  identify  between  the  three  typos  of  failures  induced  on 
the  satellite  and  transponder  range  measurement  signals:  an  additive  step  bias,  an  additive 
ramp  offset,  and  an  increase  in  measurement  noise.  Two  matching  filler  algorithms  are 
presented  as  methods  for  identifying  the  failure  type:  the  generalized  likelihood  ratio  (GLR) 
and  the  Chi-Square  Pattern  Recognition  (CSPR)  matching  filters.  The  GLR  technique 
implements  a  ratio  of  hypothesis  probabdity  densities  to  identify  failures,  while  the  CSPR 
attempts  to  match  the  shape  of  a  failure  offset  to  pre  determined  failure  model.  Both  these 
algorithms  use  the  results  of  NRS  filter  I  to  attempt  to  identify  the  failure.  The  results  of 
the  GLR  and  then  the  CSPR  matching  filters  a.re  presented,  followed  by  a  comparison  of 
the  relative  quality  of  the  two  algorithms.  The  goal  of  this  analysis  is  to  .suggest  the  best 
direction  for  future  FDIR  work  to  pursue. 

4.5.1  GLR  Matching  Filter  Results.  Overall,  the  results  for  the  GLR  algorithm 
have  fallen  short  of  expectations.  While  previous  AFIT  research  has  had  limited  success 
using  the  algorithm  as  a  method  to  identify  which  measurement  fails  [19],  the  fidelity  of  the 
algorithiu  is  not  sufficient  to  identify  the  exact  failure  type.  As  stated  in  Section  2. 3. 2.2, 
the  GLR  matching  filter  relies  on  the  magnitude  of  the  TflJ  function  to  determine  the  type 
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Figure  4.17  Comparison  of  GLR.  matching  filter  results,  T{fi),  for  a  Transponder  Slop, 
Ramp,  and  Noise  Failure 

of  failure.  As  explained  in  Equation  (2.68),  if  the  magnitude  of  T(/,  )  is  much  greater  than 
1,  the  failure  is  a  ramp  offset.  Similarly  if  the  magnitude  is  much  less  than  1,  the  failure  is 
identified  as  a  step  bias.  If  the  magnitude  remains  in  close  vicinity  of  1,  neither  step  nor 
the  ramp  GLR  failure  model  can  identify  the  failure;  therefore  the  algorithm  assumes  the 
failure  is  an  increase  in  the  measuroment  noise. 

Despite  the  efforts  to  fine  tune  the  algorithm,  the  GLR  matching  filter  is  unable  to 
distinguish  between  different  failure  types.  Figure  t.17  shows  the  response  of  the  T{ti) 
function  for  the  three  different  transponder  failures.  While  the  algorithm  seems  to  identify 
the  ramp  failure  correctly,  the  step  bias  cannot  be  distinguished  from  an  increase  in  mea- 
sureineut  noise.  In  fact  the  GLR  seems  to  believe  both  biases  are  increases  in  measurement 
noise.  For  the  satellite  measurement  failures,  all  three  failure  types  are  identified  as  ramp 
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failures.  As  can  be  seen  in  Figure  4.18,  the  GLR  is  more  confident  in  the  step  bias  being 
a  ramp  failure  than  the  actual  ramp  bias. 


Step  Ramp 


Noise 

Figure  4.18  Comparison  of  GLR  Matching  Filter  Results,  T(L),  for  a  Satellite  Step, 
Ramp,  and  Noise  Failure 

While  the  results  from  the  GLR  simulation  appear  to  be  mdora,  there  is  a  com¬ 
mon  fault  in  the  system  that  produces  these  results.  The  problem  lies  in  a  fundamental 
assumption,  made  in  the  derivation  of  the  GLR  equations.  The  GLR  equations  in  Chap¬ 
ter  II  are  derived  for  a  discrete-time  system  model.  Yet  the  model  equations  for  the 
NRS  filter  are  continuous-time  state  equations.  This  research  assumes  that  the  F  ma¬ 
trix  in  the  system  dynamics  equation  can  be  discretized  using  a  discretization  algorithm 
described  in  Section  2.2.2.  Unfortunately,  this  discretization  process  does  not  retain  essen¬ 
tial  dynamics  information  necessary  to  match  g{ti,0^)  to  the  residuals  in  Equation  (2.58). 
This  discretization  is  hampered  both  by  the  coarse  sampling  time,  2  seconds,  and  the 
assumed  first-order  approximation  (Section  2.2.2).  This  theoretical  breakdown  prevents 
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T(i,)  ill  Equatioxi  (2.67;  from  disl  nguishing  between  the  lamp  and  step  failures.  Chapter 
V  discusses  possible  solutions  to  this  dilemma.  Results  for  the  GLR  estimates  of  the  fail¬ 
ure  magnitudes  have  not  been  included  since  the  GLR  matching  filters  cannot  accurately 
specify  failure  type. 

4.5.2  CSPR  Matching  Filter  Results.  While  the  results  for  the  GLR  algorithm  are 
less  than  heartening,  the  CSPR  matching  filter  provides  hope  for  the  future  of  failure  type 
identification.  While  the  GLR  algorithm  attempts  to  use  information  from  the  residuals, 
the  F  matrix,  and  H  matrix  to  determine  the  failure  type,  the  CSPR  concentrates  solely 
on  the  residual  information  to  identify  the  failure.  Therefore  the  CSPR  algorithm  is  not 
limited  by  the  validity  of  the  discretization  of  the  state  dynamics  matrix. 

.A.S  explained  in  Se^-ion  3.4.4,  the  CSPR  uses  the  Chi-Square  output  to  determine 
the  type  of  failure.  The  failure  type  is  established  by  matching  the  shape  of  the  failure 
portion  of  the  Chi-Square  output  to  the  actual  shape  of  the  failure.  Two  criteria  are  used 
to  evaluate  the  shape  of  the  Chi-Square  output.  These  criteria  are  the  slope  and  the 
intercept  of  a  first-order  line  fit  of  the  Chi-Square  output  over  the  duration  of  the  failure. 
To  implement  this  criteria  in  real  time,  a  new  line  fit  is  taken  every  time  another  Chi- 
Square  output  is  above  the  failure  threshold.  Over  time,  the  line  fit  will  more  accurately 
match  the  shape  of  the  failure.  By  analyzing  the  slope  and  intercept  of  the  line  fits  over 
time,  the  type  of  failure  is  determined. 


Intercept  of  the  Line  Fit  Slope  of  the  Line  Fit 

Figure  4.19  NRS  Filter  1  Chi-Square  Line  Fit  Data  for  a  Satellite  Step  Bias 
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Table  4.4  Final  Slope  and  Intercept  Values  for  the  Six  Failure  Runs 


Type  of  Failure 

Desired  Slope 

Final  Slope 

Desired  Intercept 

Final  Intercept 

Transponder 
Step  Bias 

Zero  or 
Negative 

0.397 

Large  and 
Positive 

1,38  X  10-* 

Transponder 
Ramp  Bias 

Positive 

1.97 

Zero  or 
Negative 

-4.22  X  10^ 

Transponder 
Noise  Increase 

Zero  Mean 
over  Time 

0.257  X  10-2 

Zero  Mean 
over  Time 

i.68  X  102 

Satellite 

Step  Bias 

Zero  or 
Negative 

-0.969 

Large  and 
Positive 

2.76  X  10^ 

Satellite 
Ramp  Bias 

Positive 

wm 

Zero  or 
Negative 

-2.99  X  10^ 

Satellite 
Noise  Increase 

Zero  Mean 
over  Time 

0.380 

Zero  Mean 
over  Time 

5.49  X  102 

To  explain  this  somewhat  confusing  criterion>  a  satellite  step  bias  simulation  is  exam- 
iiied.  Figure  4.19  plots  the  slope  and  the  intercept  of  the  line  fit  to  the  Chi-Square  output. 
During  the  early  portion  of  the  failure,  the  line  fit  has  not  established  sufficient  points 
of  data,  so  the  slope  and  intercept  of  the  line  fit  deviate  from  expectations.  However,  as 
the  failure  continues,  the  slope  and  the  intercept  correspond  to  expectations  described  in 
Tab’e  4.4.  The  intercept  of  the  line  fit  is  a  large  positive  value  and  the  slope  of  the  line  be- 
com^.:;  ''ightly  negative.  This  identifies  the  failure  as  a  step  bias  on  satellite  measurement 
1. 


As  explained  earlier,  the  mure  data  puiiits  available,  the  better  the  line  fit  matches 
the  established  criteria.  Therefore,  Table  4.4  documents  the  final  slope  and  intercept  values 
of  the  line  fit  for  all  the  failure  runs.  The  final  slope  and  intercept  are  determined  from 
the  line  fit  incorporating  all  the  Chi-Square  outputs  that  are  above  the  failure  threshold. 
Therefore,  there  does  exist  significant  delay  in  identification  of  failure  type  using  this 
method.  Appendix  L  contains  the  full  slope  and  intercept  plots  for  all  the  failure  runs  over 
the  complete  failure  window. 


While  the  CSPR  can  identify  most  failures,  the  algorithm  is  limited  by  its  own 
definition.  The  CSPR  will  only  correctly  match  the  failure  and  the  failure  type  when  the 
Chi-Square  output  resembles  the  failure  itself.  While  this  is  usually  the  case,  there  are 
exceptions,  as  can  be  seen  in  the  Chi-Square  output  of  NRS  filter  1  during  a  satellite  ramp 
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Figure  4.20  NRS  Filter  1  Chi-Square  Results  for  a  Satellite  Ramp  Failure 

failure.  This  Chi-Square  output,  Figure  4.20,  does  not  resemble  a  slope  over  the  time  of 
failure.  While  the  failure  can  be  detected  with  the  Chi-Square  test,  the  CSPR  matching 
algorithm  will  misinterpret  the  line  fit,  yielding  an  erroneous  answor.  Further  study  into 
the  residual  response  to  failures  is  necessary  before  a  matching  filter  like  the  CSPR  can 
accurately  identify  all  failures. 

While  both  the  CSPK.  clearly  outperforms  the  GLR  matching  filter,  there  are  reasons 
to  pursue  both  algorithms  in  future  research.  While  the  GLR  requires  a  fundamental 
change  in  dehnitioii  to  be  reapplied  to  the  NRS  filter  model,  pursuit  of  the  algorithm 
does  have  a  !■  ng-terni  payolF,  Since  the  GLR  equations  are  derived  from  the  EKF  model 
equations,  the  GLR  has  the  potential  to  be  applied  to  other  models  besides  the  NRS.  On 
the  other  hand,  the  CSPR  has  provided  reasonably  successful  identificat'on  using  very  little 
computation -il  load  and  readily  available  inputs.  However  the  CSPR  algorithm  has  been 
developed  from  post-process  analysis  of  one  model  affected  with  finite  number  of  failure 
situations.  If  the  scope  of  the  research  is  broadened,  there  is  no  assurance  that  the  CSPR 
matching  filter  will  be  able  to  perform  consistently. 
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^.6  Chapter  Summary 

Thia  ends  the  analysis  of  the  data  collected  in  the  development  of  the  MNRS  FDIR 
algorithm.  The  following  chapter  summarizes  the  results  of  this  thesis  and  presents  rec¬ 
ommendations  for  future  research. 
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V".  Conclusions  and  Recommendations 


This  chapter  presents  the  conclusions  reached  in  the  research  and  development  of 
the  MNRS  FDIR  algorithm.  The  remarks  will  focus  on  the  performance  of  the  NRS 
single  filter,  MNRS  FDIR  algorithm,  and  matching  filters.  The  chapter  concludes  with 
recommendations  for  future  research  endeavors. 

5. 1  NRS  Filter  Performance 

The  15-State  NRS  filter  has  once  again  demonstrated  accurate  navigation  corrections 
in  the  simulated  environment.  This  NRS  filter  matches  the  performance  of  past  filters, 
despite  the  reduction  in  the  number  transponder  measurements  from  six  to  five  and  the 
correction  of  various  errors  in  the  NRS  truth  model.  By  keeping  only  the  essential  states 
with  increased  tuning  gains,  the  filter  can  track  the  truth  model  with  acceptable  accuracy. 

An  examination  of  the  model  has  shown  that  the  GPS  filter  state  variables  are  the 
key  to  this  reduction  in  states.  The  coupling  of  the  GPS  drift  and  clock  bias  states 
with  increased  tuning  gain  will  quickly  compensate  for  unmodelled  range  biases.  This  is 
a  highly  beneficial  quality  when  many  of  the  truth  model  range  biases  are  unmodelled 
in  the  filter.  Yet  this  characteristic  does  hamper  failure  identification  by  tracking  the 
occurrence  of  failures  like  any  other  unmodelled  range  bias.  This  is  a  trade-off  consideration 
in  developing  the  model.  If  the  sensitivity  of  the  GPS  error  states  is  reduced,  the  filter  will 
not  compensate  for  unmodelled  range  biases  such  as  ionospheric  and  tropospheric  delay. 
Since  the  choice  in  this  thesis  has  always  been  to  maintain  the  best  possible  performance 
in  the  failure- free  environment,  the  FDIR  technique  must  function  in  a  less  than  optimal 
environment.  This  decision  will  be  addressed  again  in  Section  5.3. 

The  sensitivity  of  the  model  to  changes  in  satellite  geometry  has  also  been  investi¬ 
gated.  The  filter  has  shown  that  the  PDOP  of  the  satellites  will  affect  the  accuracy  of  the 
state  estimation  in  the  NRS  implementation.  Also,  the  negative  effect  of  good  PDOP  has 
beer  demonstrated  on  the  FDIR  algorithm.  The  investigation  of  measurement  geometry 
has  been  documented  to  encourage  future  research  into  this  area. 
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3.3 


MNRS  FDIR  Performance 


The  IvINRS  has  shown  thal  a  simplified  implenienlation  of  FDIR  concepts  can  solve 
the  probleai  of  robust  navigation  in  a  failure  envircninent.  Researchers  have  a  tendency 
to  attempt  to  produce  one  solution  for  all  problems  (i.e.  failure  detection,  isolation,  and 
recovery).  Both  MMAE  and  the  GLR  algorithms  have  been  proposed  as  cure-alls  for 
the  ailments  of  FDIR.  Yet  the  MNRS  algorithm  exploits  the  positive  qualities  of  several 
theories  rather  than  just  one,  to  attain  robust  navigation. 

Throughout  various  research  endeavors  at  AFIT,  the  Chi-Square  test  has  shown  an 
ability  to  detect  the  presence  of  a  failure  rapidly  [2,  5].  Usirig  residual  information  from 
all  the  measurements,  the  Chi-Square  test  detects  failures  as  soon  as  the  residuals  deviate 
from  their  failure-free  zero-mean  behavior.  The  MNRS  uses  the  Chi-Square  variable  only 
for  its  best  quality,  rapid  and  accurate  detection  of  failures.  The  MNRS  does  not  ask  the 
Chi-Square  test  to  isolate  the  failure  or  estimate  the  failure  magnitude.  This  would  be 
couiiterprou'uctive,  since  the  Chi-Square  test  does  not  perform  these  tasks  well.  Instead 
the  MNRS  uses  other  techniques  better  suited  to  isolation  and  recovery  of  the  failure. 

Failure  isolation  and  recovery  are  accomplished  with  the  use  of  multiple  models. 
Assuming  only  single  failures,  the  multiple  models  of  the  MNRS  isolate  the  failed  signal 
at  the  rate  of  Chi-Square  detection.  Rather  than  waiting  for  a  more  time-consuming  and 
less  reliable  isolation  algorithm,  the  MNRS  has  intermeshed  the  benefits  of  the  Chi-Square 
test  and  multiple  modelling  to  identify  the  failed  measurement  signal.  Since  the  MNRS 
contains  a  model  that  does  not  receive  updates  from  the  failed  measurement,  recovery  is 
as  simple  as  switching  the  filter  used  to  correct  the  INS  solution. 

The  real  limitations  for  the  MNRS  lie  in  the  assumptions  made  in  its  development. 
The  MNRS  assumes  that  navigation  with  four  satellites  and  five  transponders  is  desirable. 
If  more  satellites  and  more  transponders  are  used  to  update  the  filter,  more  filters  are 
needed  to  maintain  the  FDIR  capabilities  of  the  algorithm.  Also,  reconfigurability  must 
be  considered  after  a  failure  has  occurred.  Once  a  measurement  has  failed,  the  entire 
MNRS  shouUi  reset  to  be  ready  for  another  failure  in  the  measurement  signals.  While  these 
problems  have  reasonable  solutions,  to  simulate  the  more  realistic  system  is  beyond  the 
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scope  this  thesis.  Nonetheless  the  performance  of  the  MNRS  demonstrates  that  exploiting 
the  benefits  of  multiple  FDIR  techniques  in  one  algorithm,  can  solve  the  problem  of  robust 
navigation  in  a  single-failure  environment. 

5.3  Matching  Filter  Performance 

The  comparison  of  matching  filter  techniques  has  not  yielded  a  clear  favorite  for  fu¬ 
ture  research.  Neither  algorithm  demonstrates  a  clear  superiority  in  performance.  While 
the  discrete-time  GLR  matching  filter  is  able  to  detect  failures,  the  continuous-to-discrete 
transformation  of  the  F  dynamics  matrix  does  not  retain  sufficient  information  to  distin¬ 
guish  between  failure  types.  Either  the  definitions  of  the  failure  models  need  to  be  altered 
or  the  GLR  algorithm  needs  to  be  rederived  using  a  continuous-time  form  of  state  equation. 
On  the  other  hand,  the  CSPR  matching  filter  does  isolate  failures  accurately  as  long  as  the 
residuals  retain  the  shape  of  the  failure.  For  the  transponder  failures,  the  CSPR  filter  has 
absolutely  no  problems,  because  the  Chi-Square  output  exactly  matches  the  shape  of  the 
failure.  This  does  not  hold  for  the  satellite  failures.  Due  to  the  GPS  filter  state’s  tendency 
to  absorb  the  bias  induced  in  the  failure  and  the  ability  of  satellite  geometry  to  affect  the 
residual  failure  response,  the  Chi-Square  test  for  satellite  failures  does  not  always  match 
the  shape  of  the  failure  itself.  When  Chi-Square  output  of  a  failure  varies  greatly  from 
the  expected  shape  of  the  failure,  the  CSPR  will  misinterpret  the  type  of  failure.  This  is 
a  fundamental  limitation  of  the  CSPR  matching  filter. 

Therefore  the  GLR  still  must  be  considered  the  more  viable  candidate  for  future 
failure  type  identification  research.  Algorithms  like  the  CSPR.  are  limited  by  the  assump¬ 
tions  made  in  there  implementation  (i.e.  the  shape  of  the  failure  is  independent  of  system 
dynamics).  The  GLR  matching  filter  has  the  theoretical  support  to  encourage  future  re¬ 
searchers  to  decipher  the  different  problems  encountered  in  this  research.  Overall  failure 
type  identification  is  still  an  extremely  open  ended  area  of  research  that  needs  further 
investigation. 
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5-4  Recommendations 

To  conclude  this  thesis,  recommendations  are  made  for  future  AFIT  research.  These 
ideas  concentrate  on  improving  the  accuracy  of  the  NRS  model  and  furthering  the  devel¬ 
opment  of  failure  type  identification  techniques. 

•  Verify  the  NRS  filter  in  a  new  simulation  environment.  All  past  research  on  the 
NRS  model  has  used  consecutive  generations  of  the  same  MSOFE  Kalman  filtering 
computer  code.  There  is  a  definite  need  to  transfer  the  code  to  a  more  interactive 
and  modern  programming  environment.  This  process  will  allow  reverification  of  past 
work  and  a  more  comprehensible  base  for  future  work. 

•  Analyze  the  impact  of  high  dynamic  profiles  on  the  NRS  model.  CIGTF  is  interested 
in  modelling  the  effects  of  GPS  signal  loss  due  to  high  dynamics  maneuvers.  By 
developing  new  models,  the  impact  of  high  dynamics  on  the  NRS  model  can  be 
addressed. 

«  Continue  the  analysis  of  filter  sensitivity  to  measurement  geometry.  This  thesis  only 
pursued  this  topic  as  an  aside;  measurement  geometry  is  an  impoitant  and  unexplored 
area  of  research  at  AFIT, 

•  Implement  a  real-world  NRS  filter  at  AFIT.  AFIT  currently  has  the  facilities  and 
equipment  to  put  together  and  test  a  hardware  version  of  the  NRS  filter.  Produc¬ 
tion  of  a  real  system  would  open  a  myriad  of  future  research  avenues  for  the  NRS 
iUgorithm. 

•  Reverify  the  accuracy  of  the  truth  model  for  the  NRS  filter.  The  AFIT  NRS  truth 
model  has  remained  unchanged  for  numerous  years.  The  relative  accuracy  of  the 
transponder  measurements  and  the  GPS  measurements  is  of  specific  importance  to 
filter  performance. 

•  Research  and  develop  a  real  velocity-aiding  model  for  the  NRS.  Every  generation  of 
NRS  research  has  shown  that  the  filter  goes  unstable  without  velocity  aiding.  Yet  an 
accurate  velocity  model  has  never  been  explored  by  AFIT.  Therefore  an  imaginary 
model  is  still  in  place  to  maintain  stability  of  the  filter.  The  development  of  a 
velocity-aiding  model  will  improve  the  validity  of  the  NRS  simulation  results. 
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Explore  alternative  fciilure  idf’ntification  algorithms.  While  the  MNRS  does  provide 
nearly  perfect  FUIR  porfonnaiice,  the  multiple  model  structure  carries  a  signifi¬ 
cant  computational  cost.  Future  research  should  explore  the  use  ol  individual  scalar 
re.skluals  of  a  single  fdter  to  delect  and  isolate  failures  in  place  of  a  multiple  model 
structure.  Th^  actual  tuning  of  the  single  filter  should  be  adjusted  to  enhance  filter 
residual  performance.  By  improving  the  performance  of  the  residuals  at  the  expense 
of  the  state  variables,  the  filter  now  has  the  single  purpose  of  FDI.  This  FDI  filter  can 
be  run  in  parallel  with  a  second  EKF  tuned  for  the  most  accurate  state  estimation. 
By  feeding  failure  data  from  the  FDI  filter  to  the  state  estimation  filter,  a  two-filter 
FDIR  technique  can  be  developed. 

Derive  and  implement  a  continuous-time  GLR  matching  filter.  A  real  problem  in 
assessing  the  problems  with  the  GLR  matching  filter  is  the  discretization  of  the  F 
matrix  inherent  in  the  algorithm.  This  discretization  may  be  causing  the  problems 
experienced  with  failure  type  identification.  Therefore  to  implement  the  GLR  equa¬ 
tions  properly,  a  continuous-time  GLR  matching  filter  is  essential,  rather  than  con¬ 
tinuing  to  try  to  force  feed  a  discrete  time  GLR  matching  filter  into  a  sampled-data 
NRS  EKF  model. 

Pursue  a  new  CSPR  based  algorithm  to  recognize  patterns  in  the  output  of  the  EKF. 
Perhaps  explore  the  possibilities  of  implementing  a  neural  net  to  identify  failure  types. 


Appendix  .4.  Error  State  Dcjuritions  for  the  Truth  and  Filter  Models 

Tabular  listings  of  the  truth  and  filler  models  are  presented.  Tables  A.l  and  A. 2  .show 
the  39  INS  stales  for  the  truth  model,  with  the  LN-93  state  nuinbors  given  for  reference  to 
the  Litton  technical  report  on  the  INS  [4],  Tables  A. 3  and  A. 4  list  the  RRS  and  GPS  states 
respectively,  and  Table  A. 5  lists  the  states  in  the  reduced -ordered  NRS  filter  inodcds. 
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Table  A.\  39-State  INS  System  Model:  First  24  States 


State 

Number 

IMBI 

Definition 

1 

X-component  of  vector  angle  from  true  to  computer  frame 

2 

se. 

Y-component  of  vector  angle  from  true  to  computer  frame 

2 

3 

Z-component  of  vector  angle  from  true  to  computer  frame 

3 

4 

0a- 

X-componeiit  of  vector  angle  from  true  to  platform  frame 

4 

5 

Y-component  of  vector  angle  from  true  to  platform  frame 

5 

6 

<Pi 

Z-component  of  vector  angle  from  true  to  platform  frame 

6 

7 

iVr 

X-component  of  error  in  computed  velocity 

i 

8 

mm 

Y-component  of  erro*  in  computed  velocity 

8 

9 

Z-component  of  error  in  computed  velocity 

9 

10 

Sh 

Error  in  vehicle  altitude  above  reference  ellipsoid 

10 

11 

dfiB 

Total  bare- altimeter  correlated  error 

23 

16 

Shi 

Error  in  lagged  inertial  altitude 

■H 

17 

ss^ 

Error  in  vertical  channel  aiding  state 

mm 

18 

Error  in  vertical  channel  aiding  state 

13 

19 

V.. 

X-component  of  accelerometer  and 
velocity  quantizer  correlated  noise 

17 

20 

Y-component  of  accelerometer  and 
velocity  quantizer  correlated  noise 

18 

21 

V. 

*•  c 

Z-component  of  accelerometer  and 
velocity  quantizer  correlated  noise 

19 

22 

S9r 

X-component  of  gravity  vector  errors 

20 

23 

Y-component  of  gravity  vector  errors 

21 

24 

mm 

Z-component  of  gravity  vector  errors 

22 
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Table  A. 2  39-St,ate  INS  System  Model:  Second  19  States 


State 

Number 


State 

Symbol 


Definition 


X-component  of  gyro  drift  rate  repeatability 
Y-component  of  gyro  drift  rate  repeatability 


LN-93 

State 


25 


30 


26 


31 


27 


2S 


/). 


Z-  component  ot  gyro  drift  rate  repeatability 


5„ 


X-component  of  gyro  scale  factor  error 


Y-component  of  gyro  scale  factor  error 
Z-componenl  of  gyro  scale  factor  error 

"  ^  ~ _ _ *  l-!_- _ 


32 


33 


29 


34 


30 


35 


31 


X-component  of  accelerometer  bias  repeatability 


48 


32 


Y-component  of  accelerometer  bias  repeatability 


49 


3.1 


/ii-component  ot  accelerometer  bias  repeatability 


50 


34 


X-component  of  accelerometer  and  velocity 
quantizer  scale  factor  error 


51 


35 


Y-component  of  accelerometer  and  velocity 
quantizer  scale  factor  error 


52 


3G 


Z-component  of  accelerometer  and  velocity 
quantizer  scale  factor  error 


X-component  of  accelerometer  and  velocity 
quantizer  scale  factor  asymmetry 


37 


54 


38 


5, 


QA, 


Y-component  of  accelerometer  and  velocity 
quantizer  scale  factor  asymmetry 


Z-component  of  accelerometer  and  velocity 
quantizer  scale  factor  asymmetry 


55 


39 


’«.A. 


56 


40 


X  accelerometer  misalignment  about  Z-axis 


66 


41 


42 


43 


Y  accelerometer  misalignment  about  Z-axis 


d3 


Z  accelerometer  misalignment  about  Y-axis 


f^i 


X-accelerometer  misalignment  about  Y-axis 


67 


68 


69 


'I’ablc  A, 3  26-St.ato  RRS  System  Model 


State 

N  umber 

iBi 

Defiiiilioii 

12 

SIh 

Range  error  due  to  equipment  bias 

13 

Svb 

Velocity  error  due  to  equipment  bias 

44 

msm 

Transponder  1  x-component  of  position  error 

45 

Transponder  1  y-component  of  position  error 

46 

musM 

Transponder  1  z-component  of  position  error 

47 

Transponder  1  range  error  due  to  atm  propagation 

48 

Transponder  2  x-component  of  position  error 

49 

wsMsm 

Transpoiider  2  y-component  of  position  error 

50 

SPt2. 

Transponder  2  z-component  of  position  error 

51 

m.Lmm 

Transponder  2  range  error  due  to  atm  propagatioiv 

52 

Transponder  3  x-component  of  position  error 

53 

Transponder  3  y-compcnent  of  position  error 

54 

Transponder  3  z-component  of  position  error 

55 

mLSM 

Transponder  3  range  error  due  to  atm  propagation 

56 

SPx4^ 

Transponder  4  x-component  of  position  error 

57 

Transponder  4  y-component  of  position  error 

58 

6Pt4, 

Transponder  4  z-component  of  position  error 

59 

msfmm 

[■BliSHM 

Transponder  4  range  error  due  to  atm  propagation 

60 

T'r<ii\spond,cr  5  x-cornpon^nt  of  positiori  orror 

61 

Transponder  5  y-component  of  position  error 

62 

Transponder  5  z-component  of  position  error 

63 

IBSSI 

Transponder  5  range  error  due  to  atm  propagation 

64 

Transponder  6  x-component  of  position  error 

65 

msm 

Transponder  6  y-component  of  position  error 

66 

^Pt5. 

Transponder  6  z-component  vif  position  error 

67 

^Rt5. 

Transponder  6  range  error  due  to  atm  propagation 

Table  A. 4  30-State  GPS  System  Model 


State 

Number 


14 


15 


State 

Symbol 


Definition 


User  clock  bias 


User  clock  drift 


68 

SV  1  code  loop  error 

69 

SRtf>0p^ 

SV  1  troposplieric  error 

70 

^  Riotii 

SV  1  ionospheric  error 

SV  1  clock  error 

SV  1  x-component  of  position  error 

73 

SV  1  y-component  of  position  error 

74 

SV  1  zycomponent  of  position  error 

75 

SV  2  code  loop  error 

76 

^Rirop'2 

SV  2  tropospheric  error 

^Riony 

SV  2  ionospheric  error 

EESSHI 

SV  2  clock  error 

79 

SV  2  x-component  of  position  error 

80 

B^SB 

SV  2  y-component  of  position  error 

81 

6z,u^ 

SV  2  z-componeiit  of  position  error 

82 

^  Rcloop;, 

SV  3  code  loop  error 

83 

^Rtropi 

SV  3  tropospheric  error 

84 

^  Ri  on  :t 

SV  3  ionospheric  error 

85 

SV  3  clock  error 

88 

SV  3  x-component  of  position  error 

87 

^y»v3 

SV  3  y-component  of  position  error 

88 

SV  3  z-component  of  position  error 

89 

SV  4  code  loop  error 

90 

^  Rtrop^ 

SV  4  tropospheric  error 

91 

^  Rion4 

SV  4  ionospheric  error 

92 

SV  4  clock  error 

93 

SV  4  x-component  of  position  error 

94 

SV  4  y-coinponent  of  position  error 

95 

SV  4  z-component  of  position  error 
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Table  A. 5  15-State  Reduced-Order  Filter  Model 


State 

Number 

Definition 

1 

se. 

X-component  of  vector  angle  from  true  to  computer  frame 

2 

se. 

Y-component  of  vector  angle  from  true  to  computer  frame 

3 

se. 

Z-component  of  vector  angle  from  true  to  computer  frame 

4 

4>x 

X-component  of  vector  angle  from  true  to  platform  frame 

5 

4>y 

Y-component  of  vector  angle  from  true  to  platform  frame 

6 

<i>z 

Z-component  of  vector  angle  from  true  to  platform  frame 

7 

6V, 

X-component  of  error  in  computed  velocity 

8 

mm 

Y-component  of  error  in  computed  velocity 

9 

SV. 

Z-component  of  error  in  computed  velocity 

10 

6h 

Error  in  vehicle  altitude  above  reference  ellipsoid 

Total  baro-altimeter  correlated  error 

BB 

Range  error  due  to  equipment  bias 

13 

^Vi, 

Velocity  error  due  to  equipment  bias 

^  A 

±  *T 

15 

^^Clkir 

User  clock  drift 
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Appendix  B.  Dynamics  Matrices  and  Noise  Values 
B.l  Definition  of  Dynamics  Matrices 

la  Chapter  3,  the  trutli  and  filter  model  dynamics  matrices  are  defined  by  the  subma- 
irices,  Fr,uer-  ^/yvs,i'  -f’/iVSia)  Fhrsi^  ^.nd  of  Equation  (3.3).  The  Fputg^  represents 

the  filter  dynamics  matrix,  which  is  also  a  submatrix  in  the  larger  truth  model  dynamics 
matrix.  The  other  three  matrices  represent  the  additional  truth  model  non-zero  portions  of 
the  F  matrix  that  simulate  the  real  world.  Tables  B.l,  B.2,  B.3,  B.4,  and  B.5  contain  the 
non-zero  elements  of  the  dynamics  submatrices  Fpiittr,  FiNSn^  Fins,,,  Frrs,,  and  F'gps, 
respectively.  All  the  undeclared  variables  shown  in  the  following  tables  are  defined  in  the 
LN-93  technical  report,  along  with  their  units  [4].  The  structure  of  the  dynamics  matrices 
below  correspond  to  the  truth  model  state  definitions  in  Appendix  A. 
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Table  B.l  Elements  of  the  Dynamics  Submatrix  Firuter 


Element 

Term 

Element 

Term 

(1,3) 

-Py 

(1,8) 

—  Cry 

(2,3) 

P^ 

(2,7) 

Crx 

(3,1) 

Py 

(3,2) 

Px 

(4,2) 

-n. 

(4,3) 

0„ 

(4,5) 

(4,6) 

~^ix^ 

(4,8) 

~CnY 

(5,1) 

0, 

(5,3) 

(5,4) 

-w,(. 

(5,6) 

‘^it. 

Crx 

(6,1) 

^-1/ 

0, 

(6:4)1 

w,f„ 

(6,5)  1 

(7,1) 

-2Vyil,  -  2V,D, 

(7,2) 

2v;o, 

(7,3) 

(7,5) 

-A, 

WBEm 

{7jn 

-V^Crx 

(7,8) 

20, 

(7,9) 

~Py  -  20y 

(8,1) 

(8,2) 

-2140,  -  2T,0, 

■aaMI 

(8,4) 

A, 

(8,6) 

-A, 

(8,7) 

-20, 

(8,8) 

—  KC'/jy 

(8,9) 

pz  +  20, 

(y,i) 

2V',ri, 

(9,2) 

2V'j,0, 

(9,3) 

-2VyQ,  -  2140, 

(9,4) 

-A, 

(9,5) 

A, 

(9,7) 

py  +  20y  +  VzCrX 

(9,8) 

— p,  —  20,  -f-  VyCnY 

(9,10) 

2gola 

(11,11) 

mmsM 

1  ft^jsec 
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Table  B.2  Elements  of  the 


Element 

Term 

Element 

(9,16) 

-^2 

(9,17) 

(10,9) 

1 

IKEB3I 

(16,10) 

1 

IffiSSI 

(17,18) 

”^3 

(18,10) 

(7,19) 

Cn 

(7,20) 

(7,22) 

1 

(8,19) 

(8,21) 

^23 

(8,23) 

(9,20) 

C32 

(9,21) 

(9,11) 

A/O 

(10,11) 

(18,11) 

A:4/600 

(18,18) 

(4,25) 

(4,26) 

(4,28) 

^3B99i 

(4,29) 

(5,25) 

(721 

(5,26) 

(5,28) 

(6,25) 

■m 

jmssm 

(6,29) 

Cn 

(7,32) 

■IftSUi 

CuAf 

(7,35) 

(7,37) 

CulAfI 

(7,38) 

(7,40) 

(7,41) 

(7,43) 

IKSiil 

(8,33) 

C23 

(8,34) 

(8,36) 

msm 

(8,37) 

MSmsMM 

(8.40) 

C23A" 

(8,43) 

(9,32) 

C32 

IRSSI 

(9,36) 

Belsfeiii 

C32\A^\ 

(9,39) 

(9,41) 


—  C32^ 


Table  B.3  Elements  of  the  Dynamics  Submatrix  Fu^Sn 


Element 

Term 

Element 

Term 

Element 

Term 

nMgn 

nai 

(20,20) 

mm 

(21,21) 

B3M 

(23,23) 

mm 

(24,24) 

Table  B.4  Elements  of  the  Dynamics  Submatrix  F/ms 


Element 

Term 

Element 

I'erm 

(47,47) 

-1/300  ft'fsec 

(51,51) 

-1/300  fP/scc 

(55,55) 

-1/300  fPjsec 

(59,59) 

-1/300  fP/sec 

(63,63) 

-1/300  fP/sec 

(67,67) 

-1/.300  fP/sec 

l'a.ble  B.5  Elements  of  the  Dynamics  Submatrix  Fqps 


tl  lenient  |  Term 

Element 

Term 

Element 

Term 

-1  fPIsec 

(69,69) 

-1/500  fp/sec 

(70,70) 

-1/1500  fPjsec 

(75,75) 

-1  fP/sic 

(70,76) 

-1/500  fPjsec 

(77,77) 

-1/1500  fPjsec 

(6?..82) 

-i  fvjsec 

(83,83) 

-1/500  fvjsec 

(84,84) 

-l/i50u  fvjsec 

(80,89) 

-1  /Ffsec 

(90,90) 

-1/500  fpjsec 

(91,91) 

-1/1500  fFjsec 

B.2  Elements  of  the  Process  Noise  and  Measurement  Noise  Matrices 

This  section  defines  the  dynamics  noie  strengths  and  measurement  noise  variances 
for  the  trur.h  and  filter  models.  The  truth  model  non-zero  dynamics  noise  strength  are 
defined  in  Tables  B.6  and  B.7.  These  noise  strengths  correspond  to  the  driving  noises 
Wpiitcr,  'lOiNs,,  '^‘’rrs,,  and  Wgps,  in  Equation  (3.3).  Note  that  the  terms  in  Ta’.'e  B.6 
are  variable  names  as  defined  in  the  Litton  technical  report  and  do  not  represent  v./nance 
terms  typically  associated  with  <7^.  The  filter  dynamics  driving  noise  terms  implemented 
after  filter  tuning  are  listed  in  Table  B.8.  Finally,  the  measurement  noise  variances  used 
in  the  truth  and  filter  models  are  presented  in  Table  B.9. 
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Table  j,6  Elements  of  Truth  Model  Process  Noise  Submatrix  for  the  INS  Truth  Model 


Element 

Term 

Element 

Term 

(4.4) 

(5,5) 

(6,6) 

(8,8) 

(9,9) 

(11,11) 

(19,19) 

(20,20) 

(21,21) 

2/3v.,4., 

(22,22) 

(23,23) 

(24,24) 

Tvablo  11.7  Elements  of  Truth  Model  Process  Noise  for  RRS  and  GPS  States 


r  Element 


Element 


Term 


6.6r.7.i;10-'3  fejsec 
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r  (68,?3l 


(75, 7, 
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(f9.S9) 


0,5  /tV.s'ec 


(51,51)  6.667x10-13 //;2/5ec 


(63,63)  6.667x10-13  ft^/sec 


(83,83) 


(90,90) 


0.004  ft^/sec 


0.004  ft'^sec 


0.004  ff^/sec 


(55,55)  6.667x10  i3  ft~/sec 


(67,67)  6.667x10-13  ft-/sec 


(70,70) 


(77,77) 


(84,84) 


(91,91) 


0.004  ft'fsec 


0.004  ft^/sec 


0.004  ft' /sec 


0.004  ft‘/sc.c 


'I'able  B.8  Filter  Process  Noise  Q  Values 


Table  B.9  Truth  and  Filter  Measurement  Noises  R  Values 


Measurement  Truth  Noise  Filter  Noise 


Baro  Altimeter 


Doppler 


Transponders 


Satellites 


B-5 


Appendix  C.  Tuning  Plots  for  an  NRS  Filter 

These  plots  are  the  baseline  filter  tuning  plots  for  a  single  NRS  filter.  The  plots 
demoiustrate  the  effect  of  the  tuning  values  implemented  in  all  ten  of  the  filters  used  in 
the  MNRS  multiple  model.  These  tuning  plots  have  been  run  using  satellites  1-4  and 
transponders  1-5. 

The  plots  in  this  section  are  error  mean  ±  1  standard  deviation  plots.  They  reveal 
the  quality  of  the  filter  tuning  and  the  filter’s  ability  to  track  the  truth  niodel.  It  should  be 
noted  that  the  plots  in  this  appendix  are  not  comparing  the  actual  filter  and  truth  states. 
The  plots  depict  the  filter  and  truth  states  translated  into  the  more  commonly  recognized 
navigation  variables  (latitude,  longitude,  north  velocity,  altitude,  etc,  etc).  The  translation 
of  the  variables  has  been  used  before  and  is  documented  in  past  AFIT  theses  [14,  18]. 

The  solid  center  line  on  the  following  plots  is  the  mean  error  time  history  for  the 
applicable  navigation  variable.  The  mean  error  is  defined  as  the  Monte  Carlo  average 
of  the  difference  between  the  filter  estimate  of  a  state  and  the  actual  truth  state.  The 
following  equation  is  the  mathematical  definition  of  the  mean  error  [9,  19,  13]: 

j=i  ;=i 


where  Xj{ti)  is  the  filter-computed  estimate  of  a  given  navigation  variable  and  Xtrue,{ti) 

lo  i,  I  It  LIP  iiiv/vi^x  Vcuu.c:  pi'.^  oufiiL'o  Va>iio*LFi^f  ('ll)  tvi  lull  jt  ly  19  lilt;  iiuiiiuci  vi 

Monte  Carlo  runs  in  the  simulation  (15  in  this  thesis). 


In  addition  to  the  center  trace,  two  more  pairs  of  lines  are  plotted.  The  first  pair  is 
the  Mean±Sigma  (represented  by  the  •  •  •  lines  in  the  plots).  These  lines  are  symmetrically 
displaced  about  the  mean  error,  The  MeanizSigrna  is  the  sum  of  the  previously 

defined  mean,  and  the  actual  filter  standard  deviation  ±\/jPjJi)  ,  where 

is  the  true  error  variance  at  time  f,.  The  true  standard  deviation  is  calcidated  from  the 
following  equation  [9,19]: 


(Tu-M  =  t  (C.2) 

\  ^  ^  j=i 
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N  is  the  number  of  runs  in  the  Monte  Carlo  simulation,  and  is  the  square  of  the 

mean  of  a  given  state  at  each  time  of  interest. 

The  second  pair  of  traces  ( —  lines)  represent  the  filter-comp ated  ±  CTjuter  values 
for  the  same  states  and  are  symmetrically  displaced  about  zero  because  the  filter  “believes” 
that  it  is  producing  zero-mean  errors  [10,  19).  These  quantities  are  propagated  and  updated 
in  the  MSOFE  [13,  18j  software,  using  the  covariance  propagation  equation  shown  in 
Chapter  II.  These  plotted  lines  represent  the  filter’s  estimate  o"  its  own  error. 

A  legend  is  provided  for  quick  reference  as  to  which  of  the  lines  on  the  graph  corre¬ 
sponds  to  which  of  the  variables  of  interest.  This  section  contains  error  state  covariance 
plots  for  fourteen  navigation  variables  of  interest. 


Table  C.l  Legend  for  Filter  Tuning  Plots 
I  Symbol  Definition 


Latitude  error,  (lit) 


Figure  C.l  Latitude  and  Longitude  Error  Filter  tuning  Plots 
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Figure  C.2  Altitude  and  North  Tilt  Error  Filter  Tuning  Plots 


(b) 

Figure  C.3  West  and  North  Tilt  Error  Filter  Tuning  Plots 


(b) 

Figure  C.4  North  and  West  Velocity  Error  Filter  Tuning  Plots 
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Figure  C.5  Vertical  Velocity  and  Barometric  Altimeter  Error  Filter  Tuning  Plots 
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S  Velocity  Bias,  (ft/s) 


GPS  User  Clo:k  Drift,  (ft/s)  GPS  User  Qock  Bias,  (ft) 


(a) 


(b) 

Figure  C.7  GPS  User  Clode  Bias  and  Drift  Filter  Tuning  Plots 
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Appendix  D.  Baseline  Plots  for  Residual  Monitormg 

The  GLR  and  Chi-Square  algorithms  implemented  in  this  thesis  rely  hea.  i.^  on  the 
residuals  produced  by  the  individual  NRS  filters  in  the  MNRS.  The  onset  of  failures  in 
the  system  is  reflected  by  the  changes  to  the  residuals  of  the  extended  Kalman  filters.  In 
this  appendix,  the  residuals  of  the  satellite  and  the  transponder  measurement  updates  are 
plotted  for  a  failure-free  run.  These  plots  are  used  for  comparison  with  the  failure  runs 
in  the  following  appendices.  These  residual  plots  are  similar  in  structure  to  the  tuning 
plots  of  Appendix  C.  Each  plot  compares  the  Monte  Carlo  mean  value  of  a  residual,  ± 
the  Monte  Carlo  calculated  standard  deviation  for  a  scalar  measurement  residual,  and  zero 
±  the  filter-predicted  standard  deviation,  .  The  derivation  of  the  three  plotted  values  is 
shown  below. 

The  center  solid  line  on  the  following  plots  is  the  mean  value  of  a  measurement 
residual.  Similar  to  the  plots  in  Appendix  C,  the  mean  value  is  defined  as  the  Monte  Carlo 
average  of  the  residual  over  the  time  history  of  the  filter  run.  The  following  equation  is 
the  mathematical  definition  of  the  mean  value  for  a  scalar  residual  [9,  13]. 

(D.l) 

;=1  ;=1 


where  7;(ti)  is  the  scalar  residual  for  the  scalar  measurement  update  Zj[ti).  The  subscript, 


icicio  ’vu  tii^  jtii  Xw^aiiw  I  uiit 


iT  iO  Iflc  I'V/VOd  llUiilUCl  ui  ivic/ui^  v^aiiu  I  ulld  ill  lll« 


simulation  (15  in  this  thesis).  hj[x(t^  ),  <;]  represents  the  jth  scalar  vector  of  the  h[x[t~),  tj] 
vector  that  corresponds  to  the  specific  scalar  measurement. 


In  addition  to  the  center  trace,  two  more  pairs  of  lines  are  plotted.  The  first  pair  is 
the  Mean±Sigma  (represented  by  the  •  •  •  lines  in  the  plots).  These  lines  are  symmetrically 
displaced  about  the  residual  mean  value,  M^{ti).  The  Mean±Sigma  is  the  sum  of  the 
previously  defined  mean,  and  the  actual  residual  standard  deviation  ±\J Py{ti)  , 

where  is  the  true  error  variance  at  time  (j.  The  true  standard  deviation  is  calculated 
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from  the  following  equation  [9,  19]. 


CTi.  rue  iti) 


(D.2) 


N  is  the  number  of  runs  in  the  Monte  Carlo  simulation,  and  is  the  square  of  the 

calculated  mean  of  a  given  residual  at  each  time  of  interest. 

The  second  pair  of  traces  (represented  by  the  —  lines)  are  the  filter-computed 
±  (^jiiter  values  for  residual  standard  deviation  [lO,  19].  Equation  (2.29)  is  used  to  calculate 
the  full  covariance  matrix  for  the  residuals.  The  scalar  residual  variances  are  the  diagonal 
terms  in  the  -h  ii]  residual  covariance  matrix.  These  plotted  lines  represent  the 

filter’s  confidence  in  the  scalar  residual. 

A  legend  is  provided  for  quick  reference  as  to  which  of  the  lines  on  the  graph  cor¬ 
responds  to  which  of  the  variables  of  interest.  This  section  contains  baseline,  no-failure 
residual  plots  for  the  nine  measurement  updates  (4  Satellites  and  5  Transponders)  in  each 
of  the  ten  NRS  filters.  The  first  plots  presented  are  for  the  NRSl  filter.  The  plots  follow 
in  order  for  the  other  nine  filters,  the  last  being  NRSIO.  Scalar  residual  plots  are  not 
presented  for  the  velocity  or  the  barometric  altimeter  measurement  updates,  since  these 
are  not  used  in  the  failure  detection  algorithm. 


Table  D.l  Legend  for  Filter  Tuning  Plots 


jum 

Definition 

-  Solid  Line 

Mean  Error 

•  •  •  Dotted  Line 

Mean  ErroriTrue  Sigma 

—  Dashed  Line 

±  Filter-Predicted  Sigma 
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Figure  D.l  NRSl  Satellite  Scalar  Residual  Plots,  Baseline 
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Figure  D.3  NRS2  Satellite  Scalar  Residual  Plots,  Baseline 
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Figure  l).6  NRS3  Transponder  Scalar  Residual  Plots,  Baseline 


Figure  D.7  NRS4  Satellite 
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Figure  D.9  NRS5  Satellite  Scalar  Residual  Plots,  Baseline 
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Tiguro  D.IO  NUS5  Transponder  Scalar  Residual  Plots,  Baseline 
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Figure  D.ll  NRS6  Satellite  Scalar  Residual  Plots,  Baseline 
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Figure  I). 12  NRS6  Transponder  Scalar  Residual  Plots,  Baseline 
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Figure  U.16  NRS8  Transponder  Scalar  Residual  Plots,  Baseline 
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Figure  D.17  NRS9  Satellite  Scalar  Residual  Plots,  Baseline 
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Appendix  E,  Residual  Plots  for  a  Transponder  Signal  Step  Failure 

This  appendix  contains  all  the  scalar  residual  data  for  the  ten  NRS  filters  during 
a  simulated  step  bias  of  800ft  on  the  Transponder  I  range  signal  from  time  t  =  'iiOOOsec 
through  t  =  dOOO^icc.  The  plots  contained  in  this  section  are  identical  in  format  as  those 
in  Appendix  D.  These  plots  arc  presented  to  support  the  validity  of  the  MNRS  as  a  valid 
FDIR  algorithm  for  an  integrated  navigation  system. 

A  legend  is  provided  for  quick  reference  as  to  which  of  the  lines  on  the  graph  corre¬ 
sponds  to  which  of  the  variables  of  interest.  This  section  contains  the  plots  for  the  nine 
measurement  updates  (4  Satellites  and  5  Transponders)  in  each  of  the  ten  NRS  filters. 
The  first  plots  presented  are  for  the  NRSl  filter.  The  plots  follow  in  order  for  the  other 
nine  filters,  the  last  being  NRS  10,  Scalar  residual  plots  are  not  presented  for  the  velocity 
or  the  barometric  altimeter  measurement  updates,  since  these  are  not  used  in  the  failure 
detection  algorithm. 


Table  E.l  Legend  for  Filter  Tuning  Plots 


Symbol 

Definition 

-  Solid  Line 

Mean  Error 

•  •  •  Dotted  Line 

Mean  Error  ±  True  Sigma 

—  Dashed  Line 

±  FilterPredicted  Sigma 
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Figure  E.l  IN  RSI  Satellite  Scalar  Residual  Plots,  Transponder  Step  Bias 
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Figure  E.2  NRSl  Transponder  Scalar  Residual  Plots,  Transponder  Step  Bias 
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Figure  E.8  NR.34  Transponder  Scalar  Residual  Plots,  Transponder  Step  Bias 
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Figure  E.9  NRS5  Satellite  Scalar  Residual  Plots,  Transponder  Step  Bias 
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Figure  E.IO  NRS5  IVansponder  Scalar  Residual  Plots,  Transponder  Step  Bicis 
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Figure  E.li  NRS6  Satellite  Scalar  Residual  Plots,  Transponder  Step  Bias 
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Figure  E.12  NRS6  Transponder  Scalar  Residual  Plots,  Transponder  Step  Bias 
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iigure  L.13  NR,S7  Satellite  Scalar  Residual  Plots,  Transponder  Step  Bias 
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Figure  E.16  NRS8  Transponder  Scalar  Residual  Plots,  Transponder  Step  Bias 
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NRS9  Satellite  Scalar  Residual  Plots,  Transponder  Step  Bias 
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Figure  E.18  NH?9  Transponder  Scalar  Residual  Plots,  Transponder  Step  Bias 
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Appendix  F.  Residual  Plots  for  a  Transponder  Signal  Ramp  Failure 


This  appendix  contains  iiinited  scaiar  residual  data  for  the  ten  NRS  filters  during 
a  simulated  ramp  offset  of  slope  [l(i  -  2000)]ft  on  the  Transponder  1  range  signal  from 
time  t  —  2000scc  through  t  =  3000aec.  I'he  plots  contained  in  this  section  are  identical  in 
format  to  those  in  Appendix  D.  These  plots  are  presented  to  support  the  validity  of  the 
MNRS  as  a  valid  FDIR  algorithm  for  an  integrated  navigation  system. 


A  legend  is  provided  for  quick  refer  ',ce  as  to  which  of  the  lines  on  the  graph  corre¬ 
sponds  to  which  of  the  variables  of  interest.  Unlike  Appendices  D,  E,  and  H,  this  section 
contains  only  the  scalar  residual  plots  for  the  failed  measurement  signal  (Transponder  1) 
in  nine  of  the  ten  fillers.  Filter  10  is  not  included,  because  it  does  not  receive  the  failed 
measurement.  The  first  plot  presented  is  for  the  NRSl  filter.  The  plots  follow  in  order  for 
the  other  nine  filters,  the  last  being  NRS9.  Scalar  residual  plots  are  not  presented  for  the 
velocity  or  the  barometric  altimeter  measurement  updates,  since  these  are  not  used  in  the 
failure  detection  algorithm. 


Table  F.l  Legend  for  Filter  Tuning  Plots 
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Figure  F,2  Transponder  1  Scalar  Residual  Plots,  Transponder  Ramp  Increase  for  NRS 
Filters  6-9 


Appendix  G.  Ihsidaal  Plots  jor  a  Transponder  Signal  Noise  Failure 

This  appendix  contains  limited  scalar  residual  data  for  the  ten  NRS  filters  during 
a  simulated  noise  increase  of  ( ISOujft  on  the  Transponder  1  range  signal  from  time  t  = 
2000sec  through  t  =  3000sec.  The  plots  contained  in  this  section  are  identical  in  format 
to  those  in  Appendix  D.  These  plots  are  presented  to  support  the  validity  of  the  MNRS 
as  a  valid  FDIR  algorithm  for  an  integrated  navigation  system. 

A  legend  is  provided  for  quick  reference  as  to  which  of  the  lines  on  the  graph  corre¬ 
sponds  to  which  of  the  variables  of  interest.  Unlike  Appendices  D,  E,  and  H,  this  seciion 
contains  only  the  scalar  residual  plots  for  the  failed  measurement  signal  (Transponder  1) 
in  nine  of  the  ten  filters.  Filter  10  is  not  included,  because  it  does  not  receive  the  failed 
measurement.  The  first  plot  presented  is  for  the  NRSl  filter.  The  plots  follow  in  order  for 
the  other  nine  filters,  the  last  being  NRS9.  Scalar  residual  plots  are  not  presented  for  the 
velocity  or  the  barometric  altimeter  measurement  updates,  since  these  are  not  used  in  the 
failure  detection  algorithm. 


Table  G.l  Legend  for  Filter  Tuning  Plots 


Symbol 

Definition 

-  Solid  Line 

Mean  Error 

•  ■  •  Dotted  Line 

Mean  Error  ±  True  Sigma 

-  -  Dashed  Line 

±  Filter-I  .edicted  Sigma 

G-1 


-3 


Appaidix  H.  Residual  Riots  for  a  Satellite  Signal  Step  Failure 


This  appendix  contains  limited  scalar  residual  data  for  the  ten  NRS  filters  during  a 
simulated  step  bias  of  3500ft  on  the  Satellite  3  pseudorauge  signal  from  time  i  =  2000sfc 
through  i  ~  dOOO.sec.  The  plots  contained  in  this  section  are  identical  in  format  to  those 
in  Appendix  D.  These  plots  are  presented  to  support  the  validity  of  the  MNRS  as  a  valid 
FDIR  algorithm  for  an  integrated  navigation  system. 

A  legend  is  provided  for  quick  reference  as  to  which  of  the  lines  on  the  graph  corre¬ 
sponds  to  which  of  the  variables  of  interest.  This  section  contains  the  plots  for  the  nine 
measurement  updates  (4  Satellites  and  5  Transponders)  in  each  of  the  ten  NRS  filters. 
The  first  plots  presented  are  for  the  NRSl  filter.  The  plots  follow  in  order  for  the  other 
nine  filters,  the  last  being  NRSIO.  Scalar  residual  plots  are  not  presented  for  the  velocity 
or  the  barometric  altimeter  measurement  updates,  since  these  are  not  used  in  the  failure 
detection  algorithm. 


Table  H.l  Legend  for  Filter  Tuning  Plots 


Symbol 

Definition 

-  Solid  Line 

Mean  Error 

•  •  •  Dotted  Line 

Mean  Error  ±  True  Sigma 

—  Dashed  Line 

±  Filter- Predicted  Sigma 
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Figure  H,1  NRSl  Satellite  Scalar  Residual  Plots,  Satellite  Step  Bias 
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Figure  H.2  NRSl  Transponder  Scalar  Residual  Plots,  Satellite  Step  Bias 


Tu&«  (•«o) 


lUD«  Uw) 


(Trans  3)  (Trans  4) 


4  $U0  IQX)  1500  2000  2500  5000  3500  4000 

'niDe(MC) 


(Trans  5) 

Figure  H.8  NRS4  Tra tispoiuier  Sralnr  Residual  Plots,  Satellite  Step  Bias 
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Figure  11.11  NRS6  Satellite  Scalar  Residual  Plots,  Satellite  Step  Bias 
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Figure  H.12  NRS6  Transponder  Scalar  Residual  Plots,  Satellite  Step  Bias 
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Figure  H.15  NRS8  Satellite  Scalar  Residual  P'ots,  Satellite  Step  Bias 
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Figure  H.18  NRS9  Transponder 
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Figure  H.20  NRSIO  Transponder  Scalar  Residual  Plots,  Satellite  Step  Bias 


Appendix  1.  Residual  Plots  for  a  Satellite  Signal  Ramp  Failure 

This  appendix  contains  limited  scalar  residual  data  for  the  ten  NRS  filters  during  a 
simulated  ramp  offset  ol  slope  [4(t  —  2000 )]ft  on  the  Satellite  3  pseudorange  signal  from 
time  t  =  2000sec  through  i  =  OOOOsec.  The  plots  contained  in  this  section  are  identical  in 
format  to  those  in  Appendix  D.  These  plots  are  presented  to  support  the  validity  of  the 
MNRS  as  a  valid  FDIR  algorithm  for  an  integrated  navigation  system. 

A  legend  is  provided  for  quick  reference  as  to  which  of  the  lines  on  the  graph  corre¬ 
sponds  to  which  of  the  variables  of  interest.  Unlike  Appendices  D,  E,  and  H,  this  section 
contains  only  the  scalar  residual  plots  for  the  failed  measurement  signal  (Satellite  3)  iit 
nine  of  the  ten  filters.  Filter  3  is  not  included,  because  it  does  not  receive  the  failed  mea¬ 
surement.  The  first  plot  presented  is  for  the  NRSl  filter.  The  plots  follow  in  order  for  the 
other  nine  filters,  the  last  being  NRS  10.  Scalar  residual  plots  are  not  presented  for  thr 
velocity  or  the  barometric  altimeter  measurement  updates,  since  these  are  not  used  in  the 
failure  detection  algorithm. 


Table  I.l  Legend  for  Filter  Tuning  Plots 


Symbol 

Definition 

-  Solid  Line 

Mean  Error 

•  •  •  Dotted  Line 

Mean  Error  ±  True  Sigma 
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Figure  I.l  Satellite  3  Scalar  Residual  Plots,  Satellite  Ramp  Bias  for  NRS  Filters  1,2, 4, 5, 6 


Appendix  J.  Residual  Plots  for  a  Satellilc  Signal  Noise  Failure 

This  appendix  coiilaiiis  limiled  scalar  residual  data  for  the  ten  NH,S  filters  during 
a  simulated  noise  increase  of  (300i;)ft  on  the  Satellite  3  pseudorange  signal  from  time 
t  —  2000sec  through  I  =  300()sec.  The  plots  contained  in  this  section  are  identical  in 
format  to  those  in  Appendix  D,  These  plots  are  presented  to  support  the  validity  of  the 
MNRS  as  a  valid  FDIR  algorithm  for  an  integrated  navigation  system. 

A  legend  is  provided  for  quick  reference  as  to  which  of  the  lines  on  the  graph  corre¬ 
sponds  to  which  of  the  variables  of  interest.  Unlike  Appendices  D,  E,  and  H,  this  section 
contains  only  the  scalar  residual  plots  for  the  failed  measurement  signal  (Satellite  3)  in 
nine  of  the  ten  filters.  Filter  3  is  not  included,  because  it  does  not  receive  the  failed  mea¬ 
surement.  The  first  plot  presented  is  for  the  NRSl  filter.  The  plots  follow  in  order  for  the 
other  nine  filters,  the  last  being  NRSIO.  Scalar  residual  plots  are  not  presented  for  the 
velocity  or  the  barometric  altimeter  measurement  updates,  since  these  are  not  used  in  the 
failure  detection  alguiithiii. 


Table  J.l  Legend  for  Filter  Tuning  Plots 


Symbol 

Definition 
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Mean  Error  ±  True  Sigma 
±  Filter-Predicted  Sigma 
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Figure  J.2  Satellite  3  Scalar  Residual  Plots,  Satellite  Noise  Increase  for  NRS  Filters  7-10 


Appendix  K.  Results  of  the  NRS  Filter  Chi-Square  Tests 

Within  the  MNRS  failure  detection  algorithm^  the  Chi-Square  test  signals  when 
a  failure  occurs  in  any  of  the  NRS  filters.  As  described  previously,  a  Chi-Square  test  is 
conducted  on  the  residuals  of  each  of  tlie  ten  NRS  filters.  The  occurrence  of  a  measurement 
failure  in  a  particular  filter  is  determined  by  comparing  the  magnitude  of  the  Chi-Square 
variable  to  an  established  failure  threshold.  If  the  Chi-Square  variable  value  exceeds  the 
threshold,  a  measurement  failure  is  declared  and  the  MNRS  looks  to  a  different  NRS  filter 
for  its  navigation  solution. 

The  following  plots  portrays  this  algorithm  completely  for  each  failure.  The  plots 
are  organized  according  to  failure  run,  beginning  with  the  baseline  run  and  concluding 
with  the  noise  failure  on  transponder  1.  For  each  of  the  failure  runs  the  following  plots  are 
presented. 

First  the  individual  Chi-Square  tests  on  the  ten  NRS  filters  arc  displayed.  These 
plots  compare  the  Chi-Square  magnitude, 

k 

XCk)=  X)  (K-1) 

with  a  predetermined  threshold,  T  =  15.  The  window  size  of  the  Chi-Square  test  was 
chosen  to  be  =  3.  The  Chi-Square  threshold  and  the  window  size  have  been  chosen  for 
good  performance  (minimize  false  alarm  rate  and  detection  delay,  while  maximizing  failure 
detection  late).  It  should  also  be  noted  that  the  residual  and  covariance  matrices,  7(t;) 
and  A(/j)  respectively,  contain  only  the  measurement  information  corresponding  to  the 
four  satellite  and  five  tranponder  updates.  Following  the  Chi-Square  plots,  the  final  two 
plots  show  when  the  individual  Chi-Square  tests  fail  the  threshold  test.  The  first  five  filters 
for  each  run  are  on  the  first  plot,  followed  by  the  last  five  filters  on  the  second  plot.  When 
an  individual  filter’s  Chi-Square  test  exceeds  ihe  threshold,  the  line  corresponding  to  that 
filter  will  switch  high.  The  filter  is  considered  to  be  navigating  accurately,  according  to 
the  Chi-Square  test,  when  the  line  is  low. 

These  plots  have  been  included  to  demonstrate  the  robust  nature  of  the  MNRS  filter 
to  single  failures.  These  plots  also  demonstrate  the  ability  for  the  MNRS  to  determine 
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which  of  the  ton  (iltors  is  producing  the  accurate  navigation  solution  during  single  nioa- 
suroment  failures. 


Maf .  Ifae  CU'Squn 


WD  1000  1500  XW  2^  3010  3XD  400 

NRSHlUrtJ 


30)  1000  1300  3CQ0  2300  3000  3300  40QU 

NRS 


Figure  K.l  Baseline  Run,  Chi-Square  Test  Results  for  Filters  1-6,  N=3 
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Figure  K.3  Threshold  Test  Results  for  the  Chi  Square  Tests  on  each  Filter,  Uasehne  Run 
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Figure  K. 8  Transponder  1  Ramp  Offset— liy  Chi-Square  Test  Results  for  Filters  7-10, 
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Figure  K.9  Threshold  Test  Results  for  the  Chi-Square  Tests  on  each  Filter,  Ramp  Offset 
on  Transponder  1 
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Figure  K.12  Threshold  Test  Results  for  the  Chi-Square  Tests  on  each  Filter,  Noise  Bias 
on  Transponder  i 
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Figure  K.14  Satellite  3  Step  Bias=3500,  Chi-Square  Test  Results  for  Filters  7-10,  N=3 
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Figure  K.15  Threshold  Test  Results  for  the  Chi-Square  Tests  on  each  Filter,  Step  Bias 
Run  on  Satellite  3 
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Figure  K.16  Satellite  3  Ramp  Offset=4t,  Chi-Square  Test  Results  for  Filters  1-6.  N=3 
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Figure  K.17  Satellite  3  Ramp  Offset— At,  Chi-Square  Test  Results  for  Filters  7-10,  N=3 
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Figure  K.18  Tnreshold  Test  Results  for  the  Chi-Square  Tests  on  each  Filter,  Ramp  Offset 
on  Satellite  3 


Figure  K,19  Satellite  3  Noise  Increase=3Q0,  Chi-Square  Test  Results  for  Filters  1-6,  N=3 
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Figure  K.20  Satellite  3  Noise  Incr(ase=:300,  Chi-Square  Test  Results  for  Filters  7-10 
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Figure  K.‘21  Threshold  Test  Results  for  the  Chi-Square  Tests  on  each  Filter,  Noise  Bias 
oil  Satellite  3 


Appendix  L.  Slope  and  Intei'cept  flcsnlts  of  the  CSFR  Matching  Filter 

Tliis  appenidx  contains  results  of  a  CSPR  luatching  filter  simulation  for  each  of  the 
six  failures  used  in  this  thesis.  The  magnitude  and  duration  of  the  simulated  failures  are 
identical  to  those  used  for  the  MNRS  simulation  runs.  Two  variables  are  documented:  the 
slope  and  intercept  of  a  line  fit  of  the  Chi-Square  test.  As  stated  in  Chapter  IV,  the  slope 
and  intercept  are  plotted  as  a  function  of  time  over  the  duration  of  the  detected  failure. 
This  duration  is  defined  as  all  points  in  time  where  the  Chi-Square  test  exceeds  the  failure 
threshold.  The  first  order  line  fit  of  the  Chi-Square  data  is  performed  in  MATLAB  [8].  The 
intercept  and  slope  for  the  three  transponder  failures  (step,  ramp,  and  noise)  are  presented 
first,  followed  by  plots  for  the  three  satellite  failures  (same  order).  Analysis  for  the  CSF'R 
simulation  is  located  in  Section  4.5. 
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